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REPRESENTATION OF CONVEX HAMILTON-JACOBI EQUATIONS 
IN OPTIMAL CONTROL THEORY 


ARKADIUSZ MISZTELA f 

ABSTRACT. In the paper we study the following problem: given a Hamilton-Jacobi equation where the Hamil¬ 
tonian is convex with respect to the last variable, are there any optimal control problems representing it? In other 
words, we search for an appropriately regular dynamics and a Lagrangian that represents the Hamiltonian with 
given properties. This problem was lately researched by Frankowska-Sedrakyan (2014) and Rampazzo (2005). 
We introduce a new method to construct a representation of a wide class of Hamiltonians, wider than it was 
achieved before. Actually, we get two types of representations: with compact and noncompact control set, de¬ 
pending on regularity of the Hamiltonian. We conclude the paper by proving the stability of representations. 

Keywords. Hamilton-Jacobi equations, optimal control theory, representation of Hamiltonians, 
parametrization of set-valued maps, convex analysis. 

Mathematics Subject Classification. 26E25, 49L25, 34A60, 46N10. 


1. Introduction 


Let A-control set, /-dynamics, /-Lagrangian, ^-terminal condition be given. For every (?o,xo) 6 [0, T] x R" 
we consider the Bolza optimal control problem 

minimize F((x,a)(-))g(x(T)) + f I(t,x(t),a(t))dt, 

Jt 0 

^ t0,x °^ subject to Jc(t) = f(t,x(t),a(f)), a(t)eA a.e. te[fo,7’], 

and x(to) — xq. 


While studying the problem ('P /(| A - 0 ), one usually requires / to be such that to every measurable control 
functions a: [fo,7’]—>A corresponds exactly one absolutely continuous solution x:[fo,7’]—>R" of the equation 

(1.1) x(t) = f(t,x(t),a(t)), a(t)eA a.e. fe[fo,7’] 

with the initial condition x(to) = xq. This is guaranteed, for instance, by the local Lipschitz continuity and 
the sublinear growth of f with respect to x. Let the terminal condition g be lower semicontinuous and the 
control set A be compact in the space R m . We assume the Lagrangian 1 is locally Lipschitz continuous with 
respect to x. The above assumptions concerning the triple (A,/,/) and the terminal condition g allow us to 
determine correctly the value function V for any (fo,xo) 6 [0,7 ] x R” using the formula 


(1.2) V(to,xo )inf {T((x,«)(■)) | (x,ci)(-) is a solution of (1.1) with x(/q) = xo) 


We say that the problems of optimal control {(7/ 0 ,. V0 ) | (fo,xo) e [0,7]xl") represent the following 
Hamilton-Jacobi equation 

-V t + H(t,x,-V x ) = 0 in (0,7)xr, 

' ^ V(T,x) = g(x) in R", 

provided the value function (1.2) is the unique viscosity solution of the equation (1.3). The assumption 
about the triple (A,/, l) and the terminal condition g imposed above, allow us to prove that the value function 
(1.2) is the unique viscosity solution of the equation (1.3) with the Hamiltonian given by the formula 

(1.4) H(t,x,p ) := sup {{p,f{t,x,a)) - l(t,x,a)}. 

aeA 

The details concerning this well-known model may be found in the wide monograph of Bardi and Capuzzo- 
Dolcetta [2], The classic results about uniqueness of viscosity solutions of the equation (1.3) are originated 
from Crandall-Lions [7, 8], Crandall-Evans-Lions [6], Ishii [14], Lions-Perthame [16] Barron-Jensen [3,4], 
Frankowska [10], Frankowska-Plaskacz-Rzezuchowski [11] and Subbotin [24]. 
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Now we shall state the converse problem that we are going to study in this article. We assume that given 
is a Hamilton-Jacobi equation (1.3) with lower semicontinuous terminal condition g and the Hamiltonian 
H satisfying the existence and uniqueness conditions, i.e. 

(EU1) H(-,x,p) is measurable for all x,p e R" and Hit, •, ■) is continuous for all te [0, T], moreover Hit,x, •) 
is convex and Lipschitz continuous with the Lipschitz constant c(f)(l + W) for all t e [0, T], x e R". 
(EU2) H(t, ■ ,p) is Lipschitz continuous on closed ball B(0,R) with the Lipschitz constant k/ftf 1 + \p\) for 
all t e [0, T] \ Mr, p e R" and R> 0, where Mr is the null set. 

In this pattern, one faces a natural question: do there exist optimal control problems {(' Pt 0 ,x 0 ) \ (to,xo) e 
[0,r] x R") that represent the equation (1.3)? In other words, we ask if there exist such a triple (A,f,l) that 
satisfies the equation (1.4) and the conditions stated above. We call such a triple (A,f,l) a faithful repre¬ 
sentation of the Hamiltonian H in the optimal control theory. The use of the name ’’faithful representation” 
is justified by the fact that there is infinitely many triples ( A,f,l ), satisfying the equation (1.4), including 
the ones with totally irregular functions /,/. The triple ( A,f,l ), not necessarily regular and satisfying the 
equality (1.4) is called a representation of the Hamiltonian H. 

Faithful representations of the Hamiltonians satisfying the existence and uniqueness conditions were 
studied first by Rampazzo [21] and next by Frankowska-Sedrakyan [12], Rampazzo [21] focused on the 
research of continuous representations with respect to t. Frankowska-Sedrakyan [12], in turn, studied mea¬ 
surable representations with respect to t. Our results include continuous as well as measurable case. Earlier, 
Ishii [15] proposed a representation involving continuous functions f,l and expressed the solution of a sta¬ 
tionary Hamilton-Jacobi equation as the value function of an associated infinite horizon optimal control 
problem. The lack of local Lipschitz function / with respect to the variable x in Ishii [15] paper causes 
that, in general, not to every control u(-) there corresponds exactly one trajectory x(-). This fact causes a 
lot of troubles in applications. Our results imply that both the dynamics / and the Lagrangian I are locally 
Lipschitz continuous in x. Theorems on representation are, in general, used to research the regularity of 
solutions of the equations (1.3). Therefore we need to construct functions f,l as regular as it is possible. 
More reference and comments concerning theorems on representations, one may find in [12, 21], 

Now, we introduce the construction of faithful representation proposed by Rampazzo in [21] and com¬ 
pare it to our construction of faithful representation. We start with construction of Rampazzo, also used by 
Frankowska-Sedrakyan in [12], We consider the Legendre-Fenchel transform of H with respect to the last 
variable, called a Lagrangian, 

(1.5) L(t,x, v ): = sup { (v,p) - H(t, x, p)}. 

peR" 

It is possible for L to achieve value +oo. The set domy? = {x \ ip(x) f ±oo] is called the effective domain of i p. 
The condition (EU1) imposed on H implies that the set-valued map F(t,x) := domLff,x, •) has nonempty, 
bounded, convex values. It might happen that values of F are not closed (see Ex. 2.13). The closed values 
of F are guaranteed by boundedness of the function L(t,x,-) on the effective domain dom L(t,x,f, assumed 
additionally by Rampazzo [21] and Frankowska-Sedrakyan [12]. The condition (EU2) imposed on // im¬ 
plies F is locally Lipschitz continuous in the sense of Hausdorff’s distance. By parametrization theorem 
[1, Thm. 9.7.2], there exists single-valued map /, with the control set A Bit), 1) c R", satisfying the local 
Lipschitz conditions with respect to x and f(t,x,A) = F(t,x). If H(t,x,-) is finite and convex for each (t, x), 
then by Fenchel-Moreau theorem we can retrieve H from L by performing the Legendre-Fenchel transform 
for a second time: 

(1.6) Fl(t,x,p)- sup { lp,v) - L(t,x,v) ). 

veM" 

We notice that by (1.6), of the definition of F and equality f(t,x,A) = F(t,x) we get 


Fl(t,x,p) = sup {(p,f(t,x,a)) -L(t,x,f(t,x,a))}. 
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It means the triple ( A,f,l ) is the representation of H provided l(t,x,a)L(t,x,f(t,x,a)). The question of 
function / regularity still needs to be clarified. It turns out that with the above assumptions, the function 
l may not be even continuous with respect to the variable x (see Ex. 3.7). It is the consequence of the 
fact that if H satisfies the existence and uniqueness conditions, then the function (x, v) —> L(t,x,v) is, in 
general, lower semicontinuous, even if the Lagrangian is bounded on the effective domain (see Ex. 2.11). 
Therefore Rampazzo [21] and Frankowska-Sedrakyan [12] introduced an additional assumption (H5). This 
assumption together with the assumption (EU2) implies that the function (x,v) —> L(t, x, v) is Lipschitz 
continuous on (5(0, R) x R") Pi dom Lit, •, •) for all t e [0, T] \ Mr and R > 0. Hence, in an obvious way 
we obtain, that l satisfies the local Lipschitz continuity with respect to x. Examples show that (H5) is a 
strong assumption. Hence Rampazzo states in [21] an open question - how the assumption (H5) could 
be weakened. Another problem connected to the considered construction of the faithful representation 
concerns the unboundedness on the Lagrangian on the effective domain. In this case, it might happen that F 
does not have closed values (see Ex. 2.14). Therefore the parametrization theorem [1, Thm. 9.7.2], utilized 
to construct the function / may not be applied to F. Our construction of faithful representation, to which 
we now move, nicely handles indicated problems. 

Let us define the set-valued map El : [0, T] x R" ^l"xR by the following formula 

El(1,x) := {(v,rj) e R” x R | L(t,x,v ) ^ rj). 

The set epiy? = {(x,rj) \ ip(x) ^ /?} is called the epigraph of </?. We notice that El(1,x ) = epiL(f,x, •)• The 
condition (EU1) imposed on H implies E/ has nonempty, closed, convex values. Off course, El has un¬ 
bounded values. The condition (EU2) imposed on FI implies E/ is locally Lipschitz continuous in the sense 
of Hausdorff’s distance. This fact is known, e.g. see [5, Lem. 2 in Sec. 4.2]. From parametrization theorem 
[1, Thm. 9.7.1], there follows the existence of a single-valued map e : [0,T] x R" x A —> R” x R, with the 
control set A := R” +1 that satisfies the local Lipschitz continuity with respect to x and 

e(t,x,A ) = EL(t,x). 

We define the function / : [0, T] x R" x A —> R" and l : [0, T] x R" x A —> R by formulae: 

(1.7) f(t,x,a) := 7r v (e(t,x,a)) and l(t,x,a)n n (e(t,x,a)), 

where n v (v, rj) = v and n n (y, rj)-r] for all v e R” and >} e R. Then for any 1 6 [0, T], x e R", a € A the following 
equality holds 

e(t,x,a) = ( f(t,x,a),l(t,x,a )). 

It follows from the above that the functions f,l have the same properties as the function e. Moreover, we 
prove that the triple ( A,f,l ) constructed like above, is the representation of H and f(t,x,A) = dom Lit,x, •) 
(see Prop. 5.7). Let us notice that for the above construction of the faithful representation, the assumption on 
Lagrangian boundedness on the effective domain as well as the assumption (H5) are superfluous. However, 
the control set is noncompact. This result allows us to study the Hamilton-Jacobi equations (1.3) with 
Hamiltonians whose Lagrangians are not bounded on effective domain. In addition to this, it gives the base 
for research of Hamilton-Jacobi equations (1.3) with Hamiltonians satisfying even more general conditions 
of existence and uniqueness studied in articles [9, 13, 18, 20, 22]. 

The construction of the faithful representation with a compact control set is more complicated than the 
previous one. It turns out that for the Hamiltonians satisfying the existence and uniqueness conditions, the 
faithful representation with a compact control set not always exist. The necessary condition for existence of 
the faithful representation with a compact control set is the boundedness of the Lagrangian on the effective 
domain. To be more precise, we prove that if there exists a faithful representation (A,/, l) of the Hamiltonian 
H with a compact control set A, then there exists a function A : [0, T] x R" —» R with A(t, x) ^ L(t, x, v) for 
every t e [0, T], x e R", v e domL(f,x, •) and A(t, ■) is locally Lipschitz continuous for all t e [0,T] (see 
Thm. 3.3). It means that if the Lagrangian is not bounded on the effective domain (see Ex. 2.14), then 
there are no faithful representation with a compact control set. Hence, as it follows from our results, the 
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assumption on boundedness of the Lagrangian on the effective domain proposed by Rampazzo [21] and 
Frankowska-Sedrakyan [12] was not superfluous. 

Now we describe the construction of the faithful representation with a compact control set. We assume 
that the Lagrangian L is bounded on the effective domain by the function A. We define the set-valued map 
Ea.l ■ [0, T] xR" -^R"xK by the following formula 

EajARx) := {(v, i~f) e R" xR | L(t,x,v) ^ // ^ A(t,x )}. 

If, additionally, H satisfies the existence and uniqueness conditions, we may show that E,^l has nonempty, 
compact and convex values. However, E,^l does not, in general, satisfy the local Lipschitz continuity in the 
sense of the Hausdorff’s distance. Thus, applying parametrization theorem [1, Thm. 9.7.2] to E^l, we will 
not achieve appropriately regular parametrization. Therefore, we propose other solution of this problem. 
It bases on constructing, with the use of the technics appearing in the proofs of parametrization theorems 
[1, Thm. 9.7.1 and 9.7.2], a function e : [0,7]xR"xA —> R" xR, with the control set A := B( 0,1) c R n+1 , 
satisfying the local Lipschitz continuity with respect to x and 

(1.8) Ex ^(t,x) c e(t,x,A ) c El(1,x). 

We notice that the function e is neither a parametrization of E,\ i nor a parametrization of E[ (t,x). Despite 
this, the inclusions (1.8) suffice for the triple (A,/,/) to be the representation of 77, where / and / are given 
by (1.7) (see Prop. 5.10). Let us notice that for the above construction of the faithful representation, the 
assumption (H5) in [12, 21] is superfluous. It means that our construction of the faithful representation 
solves the problem of Rampazzo stated in [21], 

The main results of this article are proved while more general assumption then (EU2) is supposed. 
Actually, we assume that the Hamiltonian 77 satisfies a condition of the type 

V7? > 0 3k R (-) 3 w r (-,-) Vt € [0,71 \Af R Vx,ye 5(0,7?) Vp € R" 

\H(t,x,p)-H(t,y,p)\ < k R (t) ■ \p\ ■ \x-y\ + w R (t, \x-y\), 

where w R (t, ■ ) is local modulus. The above condition still guarantees the existence and uniqueness of viscos¬ 
ity solution of the equation (1.3) (see [8, 15]). We notice that the Hamiltonian 7/ given by the formula (1.4) 
satisfies the condition (EU3), if f(t,-,a) is ^(f)-Lipschitz and l(t,-,a) is w R (t, • )-continuous on the ball 
5(0,7?) for all t e [0,71 \ A f R , a e A and 7? > 0. In fact, we are interested in a converse situation, i.e. if 
the Hamiltonian 7/ satisfies conditions (EU1) and (EU3), does there exists a representation (A,/,/) of the 
Hamiltonian 77 with the functions /, / with the above properties. Well, our results contained in Theorems 3.1 
and 3.6 do not answer this question. Indeed, functions / appearing in these Theorems do not satisfy the 
local Lipschitz condition with respect to x. Right now, we work on the solution of this problem that lies, as 
we suppose, in the regularity of Steiner selection. We know the condition (EU3) implies that the set-valued 
map x —> dom L(t,x,-) is locally Lipschitz continuous in the sense of the Hausdorff’s distance. This fact is 
a corollary of Theorem 2.5 (see Rem. 2.7). In addition to this, it follows from our construction of a repre¬ 
sentation that f(t,x,A) - dom L(t,x,-). Therefore / parameterizes the effective domain of the Lagrangian. 
Unfortunately, this does not imply that / satisfies the local Lipschitz condition with respect to x. We still 
suppose that the function / with such a property may be constructed using a similar recipe like the one 
contained in this paper. 

Another result we have obtained is the stability of the faithful representation constructed above. In 
Section 6 we show that if 77/ converge uniformly to 77 on compacts in [0, T] x R" x R", then f) converge to 
/ and 7,- converge to / uniformly on compacts in [0, T] x R" x A. The proof of this fact bases on Wijsman’s 
Theorem [23, Thm. 11.34], 

The outline of the paper is as follows. Section 2 contains hypotheses and preliminary results. In Section 3 
we gathered our main results. Sections 4, 5, 6 contain the proofs of results from Section 3. 
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2. Hypotheses and preliminary results 

An extended-real-valued function is called proper if it never takes the value -oo and is not identically equal 
to +oo. If H(t,x,-) is proper, convex and lower semicontinuous for each (t,x), then the Lagrangian L(t,x,-) 
given by (1.5) also has these properties (see [23, Thm. 11.1] ). Furthermore, by [23, Thm. 11.1] we have 
H(t,x,-) = L*(t,x,-) and L(t,x, •) = H*(t,x,-), where * denotes the Legendre-Fenchel transform. We denote 
by (v,p) the scalar product of v,p e R” and by \p\ the Euclidean norm of p. 

Let us describe the hypotheses needed in this paper. 

(HI) H : [0, T] x R" x R" —> R is f-measurable for any (x,p) e R" x R"; 

(H2) H(t,x,p ) is continuous with respect to (x,p) for every t e [0, T]\ 

(H3) H(t,x,p ) is convex with respect to p for every ( t,x) e [O.T] x R"; 

(H4) There exists a measurable map c : [0, T] —> R+ such that for any ( t,x) e [0, T] x R" 
and for all p,q e R" it satisfies \H(t,x,p)-H(t,x,q)\ < c(f)(l + \x\)\p-q\. 

Proposition 2.1. We suppose that H satisfies (H1)-(H3). IfL is given by the formula (1.5), then 
(LI) L : [0, f]xR”x R" —> R U [+oo] is Lebesgue-Borel-Borel measurable; 

(L2) L(t,x, v) is lower semicontinuous with respect to ( x,v)for every t e [0, T]; 

(L3) Lit , x, v ; ) is convex and proper with respect to v for every ( t, x) e [0, T] x R”; 

(L4) V(f,x,v) e [0, IT] xR"xR" V x, —> x 3 v,- —> v : L(f.x,,v,) —> L(t,x,v); 

Additionally, if H satisfies (H4), then 
(L5) V (f, x, v) e [0, T] x R" x R" : |v| > c(f)(l + |x|) L(t,x,v) = +oo; 

Additionally, if H is continuous, then L is lower semicontinuous and 
(L6) V(f,x,v) e [0.T] xR"xR" V(f,.x,) —» (t,x) 3v,-—»v : L(ti,Xj,Vj) —» L(t,x,v). 

Proposition 2.1 can be proven using well-known properties of the Legendre-Fenchel transform that can 
be found in [23]. 

Definition 2.2. We say that a set-valued map F : [0, T] —o R'" is measurable, if for every open set U c R m 
the inverse image L -1 (U) := {t e [0.T] | F(t) DU f 0} is Lebesgue-measurable set. 

From the condition (LI) we gather that a set-valued map t —> E/(t,x) is measurable for all x e R". The 
conditions (L2)-(L3) imply that the set Ejft,x) is nonempty, closed and convex for all t e [0, T], x e IK". 
The set gphf := { (z,y) \ y e F(z) } is called a graph of the set-valued map F. 

Definition 2.3. We say that a set-valued map F : R" —° R"' is lower semicontinuous in Kuratowski’s sense, 
if for every open set U c R m the inverse image F~ l (U) is an open set. It is equivalent to the following 
condition 

V (z„y) e gphL V Zi -> z 3 yt -> y : y, e F(zd for all large i e N. 

The condition (L4) means that a set-valued map x —> E/f t, x) is lower semicontinuous for every t e [0, T], 
The condition (L2) implies that a set-valued map x —> Ej it, x) is not only closed-valued, but also it has the 
closed graph for every t e [0, T], Lor a nonempty subset K of R" we define ||/if|| := sup v€jc |x|. Lrom the 
condition (L5) we have that ||domL(f,x, Oil ^ c(f)(l + |x|) for every t e [O.T], x e R". If L is lower semi¬ 
continuous and satisfies (L6), then the set-valued map El has a closed graph and is lower semicontinuous. 
Combining the above facts we obtain the following corollary. 

Corollary 2.4. We suppose that H satisfies (H1)-(H3). IfL is given by (1.5), then 
(Ml) El(1,x) is a nonempty, closed, convex subset of R" +1 for all (t,x) e [0, T] x R"; 

(M2) x —> El(1, x) has a closed graph for every t e [0, IT]; 

(M3) x —> El(1, x) is lower semicontinuous for every t e [0, T]; 

(M4) t —> El(1,x ) is measurable for every x 6 R"; 

Additionally, if H satisfies (H4), then 
(M5) ||domL(f,x,-)ll < c(f)(l + |x|)/or every (t,x) e [0,r]xR' ! ; 
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Additionally, if H is continuous, then 
(M6) ( t,x ) —> El(1,x ) has a closed graph and is lower semicontinuous. 

2.1. Lipschitz set-valued map x —» E/Jt,x). In this section we present Hausdorff continuity of a set¬ 
valued map in Lagrangian and Hamiltonian terms. The notations Br and /AO, R) stand for the closed ball 
in R" centered at zero and with radius R f 0. Additionally, we set B := B\. The function w : [0, T] x 
[0, °o) —> [0, °o) will be called modulus, if w(-, r) is measurable for any r G [0, °o) and w(t, •) is nondecreasing, 
continuous and subadditive function satisfying w(t, 0) = 0 for all t e [0,7’]. 

The main hypothesis of this paper. 

For any R > 0 there exists kR : [0, T] —> R+ - measurable and w R f, •) - modulus and 
(HLC) A/fl - null set such that \H(t,x,p) - H(t,y,p)\ ^ kR(t)\p\\x-y\ + WR(t,\x-y\) for all 

t e [0, T] \ Nr and for every x,y e Br, p e R”. 

The above condition is needed for the uniqueness of the solution of the equation! 1.3). It is described in [19], 

Theorem 2.5. We suppose that a function p —> H(t,x,p ) is finite and convex for every ( t,x ) G [O.T] x R". 
Let L(t,x,-) — H*(t,x,-) and H(t,x,-) = L*(t,x,-) for every ( t,x ) G [0,T] xR". Then we have equivalences 
(HLC) o (LLC) o (MLC): 

For any R > 0 there exists kR : [0, T] —> R+ — measurable and wr(-, •) - modulus and 
(LLC) Nr — null set satisfying the condition : V t e[0, r]\A/fl V x,y e Br V v e domL(f,x, •) 

3m e domL(f,y,•) such that \u — v\ ^ kR(t)\y — x\ and L(t,y,u) L(t,x,v) + WR(t,\x — y\). 

For any R > 0 there exists kR : [0, T] —> R+ - measurable and h’k(-, •) - modulus and 
(MLC) Nr - null set such that Ei{t,x) c Ei(t,y ) + (kR(t)\x-y\B) X (wR(t, |x-y|) [-1,1]) 

for all t e [0, T] \Nr and for every x,y e Br. 

Equivalences hold for the same functions kR(-), wr(-,-) and the set Nr. 

Theorem 2.5 is an extended version of Clarke’s result (see [5, Lem. 2 in Sec. 4.2]). Our Theorem 2.5 
follows from Propositions 2.9 and 2.10 that are proven below. Let K be a nonempty subset of R m . The 
distance from x e R m to K is defined by d(x,K) := inf ye jf \x-y\. For nonempty subsets K, D of R m , the 
extended Hausdorff distance between K and D is defined by 

(2.1) max < sup d(x,D), sup<7(.Y,7T) > 6 Ru ]+oo}. 

I xeK xeD J 

By Theorem 2.5 and the condition (MLC) we obtain the following corollary. 

Corollary 2.6. We suppose that H satisfies (HI)—(H3) and (HLC). IfLis given by (1.5), then for any R > 0, 
for all t e [0, T] \ Nr and for every x,y e Br we have 

(2.2) ,N(E L (t, x),E L (t,y)) < 2k R (t)\x-y\ + 2w R (t,\x-y\). 

Remark 2.1. Using the condition (LLC) we easily infer that a set-valued map Fi{t,x) = dom L(t,x, •) satis¬ 
fies the inequality Jlf(F L (t,x),Fi(t,y)) ^ k R (t ) \x-y\ for all t e [0, T] \Nr, x,y G Br and R> 0. This means 
that a set-valued map x —> Fi(t,x ) is f)—Lipschitz on the ball Br for all t g [0, T] \Nr and R> 0. We 
notice that passing from the inclusion (MLC) to the inequality (2.2) we lose this property. Therefore, the 
inequality (HLC) is stronger than the inequality (2.2). 

The epi-sum of functions <p\,ip 2 ■ R” —> RU]+oo] is a function g>\ : R" —> RU{+oo] given by the 

formula 
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Lemma 2.8 ([23, Thm. 11.23]). We suppose that functions h\,h 2 : R" —» RU{+oo) are proper, convex and 
lower semicontinuous. Let the set dom h* be bounded. Then the epi-sum h\ ft h\ is a proper, convex and 
lower semicontinuous function. Besides, we have the equality 

(2.3) (hi+h 2 y=h\$h* 2 . 

Proposition 2.9. We suppose that p — > H(t,x,p ) and p — > H(t,y,p ) are proper, convex and lower semicon¬ 
tinuous. Let L(t,x,-) H*(t,x,-) and L(t,y,-) := H*(t,y,-). Then the following conditions are equivalent: 

(a) H(t,x,p ) ^ H(t,y,p) + k R (t) \p\ \x-y\ + w R (t,\x-y\) for all p e R". 

(b) For all v e domL(f,x, •) there exists u e domL(f,y, •) such that 
\u-v\ ^ k R (f)\x—y\ and L(t,y,u) ^ L(t,x,v) + w R (t,\x-y\). 


Proof. We start with the implication (a) => (b). Let h\{p) : = H(t,y,p ), li 2 (p) : = k R (t)\p\ \x-y\ + w R {t,\x-y\), 
h 2 (p)h\(p) + li 2 (p), hy(p) '.= H(t,x,p) for every p e R". Of course, h\(v) = L(t,y,v) and h\(v) = L(t,x,v ) 
for every v € R". It is not difficult to calculate the following for every v e R". 


(2.4) 


h\(y) = 


-w R (t,\x-y\) if |v| < k R {t)\x-y\ 
+o° if |v| >k R (f)\x-y\. 


we notice that functions h \, h 2 satisfy assumptions of Lemma 2.8. Therefore, by the equality (2.3) we have 
for every v € R", 


(2.5) 


hliv) = (hx+h 2 T(y) = h\ ft/i^v). 


By (2.4), (2.5) and the definition of the epi-sum we get for every v € R" 


(2.6) h* 3 (v)= inf {L(t,y,u)-w R (t,\x-y\)}. 

u:\v-u\^k R (t)\x-y\ 

The inequality (a) implies !u{p) f h 2 (p) for every p € R". Therefore, by the property of the Legendre- 
Fenchel transform we obtain h%fv) ^ h\(v) for all v 6 R". Using the property (2.6) we have for all v e R" 

(2.7) L(t,x,v )> inf {L{t,y,u)-w R {t, \x-y\)}. 

u:\v-uKk.R(t)\x-y\ 

The function u —> L(t,y, u ) - w R (t, \x-y\) is lower semicontinuous, so it achieves its minimum on the compact 
set {u | \v — u\ ^ k R {t)\x—y\ }. Using the inequality (2.7), we obtain the condition (b) from the proposition. 

Now, we prove the implication (b) => (a). To this end, we fix /? e R". If H(t,y,~p) = +oo, then the 
inequality (a) holds. We suppose that H(t,y,~p) < +oo. Then the value H(t,y,~p) is a real number, because the 
function p —> H(t,y,p) is proper. We suppose that H(t,x,~p) = +°o. Next, we set M := H(t,y,~p) + k R (t ) \p\ \x- 
y\ + w R (t, |x-y|). Because H(t,x,-) = L*(t,x,-), there exists v e dom L(t,x, •) such that 


( 2 . 8 ) 


M < (p,v)-L(t,x,v). 


By the condition (b), there exists u e dom L(t,y, •) such that 


(2.9) \u- v| < k R {t)\y-x\ and L(t,y,u) < L{t,x,v) + w R {t,\y-x\). 

By the inequality (2.8) and (2.9) we obtain 


M < (p,v)-L(t,x,v) + H(t,y,p)- sup {(p,v) - L(t,y,v)} 

veR" 

^ fp, v) - L(t, x,v) + H(t,y,p)- (p, u) + L(t, y, 77) 

^ H(t,y,~p) + \~p\\v-u\ +L(t,y,u) - L(t,x,v) 

< H(t,y,p) + k R (t)\p\\x-y\ + w R (t,\x-y\) - M. 


The above contradiction means that H(t,x,p) < +oo. Then the value H(t,x,p) is a real number, because the 
function p —> H(t,x,p) is proper. We set s > 0. As H(t,x,-) = L*(t,x,-), there exists v e dom L(t,x,-) such 
that 


(2.10) 


H(t,x,p ) - s ^ (p,v) - L(t,x,v). 
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By the condition (b) there exists 17 e dom L(t,y, •) such that 

(2.11) |77-v| < k R (f)\y-x\ and L{t,y,u) < L(t,x,v) + w R (t,\y-x\). 

By the inequality (2.10) and (2.11) we obtain 

H(t,x,p)-s < (p,v)-L(t,x,v)+H(t,y,p)- sup {(p,v) - L(t,y,v)} 

veR" 

^ (p, v) - Lit, x, v) + H(t, y , /?) - (p, 77) + L(t, y , u) 

Sj H(t,y,~p) + |p| |v — 77| + L(t,y,u) - L(t,x,v) 

< H(t,y,p) + k R (t)\p\\x-y\ + w R (t,\x-y\). 

As s > 0 is an arbitrary number, we get H(t,x,~p) ^ H(t,y,~p) + k R (t) \p\ \x - y\ + w R (t, \x -y|). Also, p e R" 
is arbitrary, so we have the inequality H(t,x,p) ^ H(t,y,p)+kR{t) \p\ \x-y\ + w R (t, \x-y\) for every p e R". 
It ends the proof. □ 

Proposition 2.10. We suppose that v —> L(t,x,v ) and v —> L(t,y,v ) are proper. Then the following conditions 
are equivalent: 

(a) For all vedomL(<,j,-) there exists u 6 domL(f,y, •) such that 
\u- v| ^ k R (t)\y-x\ and L(t,y,u) ^ L(t.x,v) + WR(t,\y-x\). 

(b) E L (t,x ) c E L (t,y) + (k R (t)\x-y\B)x(w R (t,\x-y\)[-l,l])- 

Proof. We start with the implication (a) => (b). Without loss of generality we assume that x / y. Let 
(v, 77 ) e Ei(t,x). Then L(t,x,v) f ij. Thus, v e dom L(t,x,-), because the function v— >L(t,x,v) is proper. By 
the condition (a), there exists u € dom L(t.y, ■) such that 

(i) \u-v\ < k R (t)\y-x\ and (ii) L(t,y,u) ^ L(t,x,v)+ w R (t,\y - x\). 

Let us define b e R", p e R i s e [—1,1] in the following way: 

b:- \ U —- if k R (t) > 0, b := 0 if k R (t) = 0, p := q+ w R (t,\y - x\), s := - 1. 

k R (t)\y-x\ 

We notice that from (i) we have b eB. Besides, from (ii) we obtain (ii.p) e epi L(t,y, •), because 
L(t,y,u ) < L(t,x,v) + w R (t,\y-x\) < q + w R {t, \y-x\) = p. 

Therefore, (fc,s)€fix[-l,l] and (u,p) e Ei{t,y). Thus, we get 

= ( u,p) + (k R (t)\y-x\b,w R (t,\y-x\)s ) 

e E L (t,y) + ( k R (t) \x - y\B) x ( w R (t, \x - y|) [-1,1]). 

Thus, the condition (b) of the proposition is proven. 

Now, we work with the implication (b) => (a). Let v e dom L(t,x,-). Then (v,L(t,x,v)) e Ei(t,x). There¬ 
fore, by the condition (b) we obtain 

(v, L(t, x, v)) e E L (t,y) + ( k R (t) \x - y\ B ) x ( w R (t, \x - y|) [-1,1 ]). 

So, there exists ( u,p ) e E R (t,y) and ( b,s ) eBx [-1,1] such that 

(2.12) (v,L(t,x,v)) = ( u,p) + (k R (t)\y - x\b ,w R (t,\y - x\) s ). 

(u,p) e Ei{t,y ), so L(t,y,u ) ^ p. Hence u e domL(f,y, •), because the function v —» L(t,y,v ) is proper. By 
the equality (2.12) we have |u - v| = k R (t) \y - x\ \b\ Sj k R (t ) \y - x\ and 

L(t,y,u ) SC p = L(t,x,v) + w R (t, |y-x|)(-i) 
sj L(t,x,v) + w R (t, |y-x|). 

Thus, we have proven that for every v 6 domL(f, x, •) there exists u e epi L(t,y,-) such that |«-v| ^ k R (t) |y-x| 
and L(t,y,u) ^ L(t,x,v ) + w R {t,\y — x\). It ends the proof of the proposition. □ 



REPRESENTATION OF HAMILTONIAN 


9 


2.2. Examples of Hamiltonians satisfying (H1)-(H4) and (HLC). In this subsection we present a 
few examples where the assumptions of our theorems about representation we shall state in the next section 
are satisfied. These examples have nonregular Lagrangians, so they do not fulfill conditions of theorems 
contained in [12, 21]. Basically, they show how general our results are comparing to those in [12, 21]. 

Example 2.11. Let us define the Hamiltonian H : Rx R —> R by the formula 

H(x,p ) := max{ |p||x| - 1,0). 

This Hamiltonian satisfies conditions (H1)-(H4) and (HLC). Conditions (H4) and (HLC) follow easily 
from the equality H(x,p) = {\px\ — 1 +11 — |px||)/2, that is satisfied for all x,p e R. The Lagrangian L : 
R x R —> R U { +oo] given by the formula (1.5) has the form 


L(x, v) = 


Obviously, domL(x, •) = [—|x|,|x|] for all x e R. Besides, the function (x, v) —» L(x,v) does not satisfy the 
assumption (H5) of [12, 21]. Indeed, it is not continuous on the set domL, because 


+oo 

if 

v£[-|x|,|x|],x/0. 

1 v 1 

1 X1 

if 

v e [—|x|,|x[], x#0, 

0 

if 

II 

O 

* 

II 

O 

+oo 

if 

t' # 0, x = 0. 


lim L(1 /i, ] /i) - 1 /0 = L(0,0). 


Example 2.12 (Rampazzo). Let us define the Hamiltonian H : R x I 


: by the formula 


H(x,p ) := \J 1 + p 2 - \x\. 


This Hamiltonian satisfies assumptions (H1)-(H4) and (HLC). The Lagrangian L: RxR —> RU[+oo] given 
by the formula (1.5) has the following form 


L(x,v) = 


-Vl — v 2 + |x| if v € [—1,1], 
+oo if v^[—1,1], 


Obviously, domL(x, •) = [-1,1] for all x e R. We notice that the function (x,v) —> L(x, v) is continuous on 
the set domL, but it does not fulfill the condition (H5) that can be found in [12, 21], 


Example 2.13. Let us define the Hamiltonian H : R x 

H(x,p) := 


1 by the formula 


p — 1 — |x| if p^~ 1, 
—2-v/ = /J — |x| if p<-l. 


This Hamiltonian satisfies assumptions (H1)-(H4) and (HLC). The Lagrangian L : 
by the formula (1.5) has the following form 


+oo) given 


L(x,v) = 


i + |x| if v e (0,1], 
+oo if v^(0, 1]. 


The set domL(x, •) = (0,1 ] is neither closed nor open and the function v —» L(x, v) on this set is not bounded 
for every x e R. It means that the Lagrangian does not satisfy conditions of [12, 21]. 

Example 2.14. Let us define the Hamiltonian H : R x R —> R by the formula 

(y/\xp\- 1) 2 if \xp\> 1, 


H(x,p) := 


0 


if |xp| < 1. 
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This Hamiltonian satisfies assumptions (H1)-(H4) and (HLC). The Lagrangian L:KxR 
by the formula (1.5) has the following form 


( +oo 


L(x,v) = { 


|v| 

\x\-\v\ 

0 

+oo 


if vg(-|x|,|x|), x#0, 

if vg (-|x|,|x|), x/0, 

if t' = 0, x = 0, 
if v / 0, x = 0. 


| given 


The set dom L(x, •) = (—|x[, |x|) is not closed and the function v —> L(x, v) is not bounded on this set for every 
x G R\{0). Besides, the function (x,v) —» L(x,v) is not continuous on the set domL. It means that the 
Lagrangian does not satisfy conditions of [12, 21]. 


Example 2.15. Let us define the Hamiltonian H : [0, T] x R x R — > R by the formula 

p 2 

H(t,x,p) := -—— - |x[. 

^ 2 + 2 1 

This Hamiltonian satisfies assumptions (H1)-(H3) and (HLC). We notice that it does not satisfy the condi¬ 
tion (H4). Nevertheless, it fulfills weaker (than in the current paper) conditions of existence and uniqueness 
that were considered in [13, 18, 20]. The Lagrangian L : [0J]xMxR->RU [+oo] given by the formula 
(1.5) has the following form 

L(t,x,v ) = (1 + t)v 2 + \x\. 

Obviously, dom L(t,x, •) = R for every t G [0, T], xg R. Besides, the function v —» L(t,x,v) is not bounded 
on dom L(f,x,-) for every t G [0,T], x G R. It means that Lagrangian does not satisfy conditions of [12, 21], 
Additionally, a set-valued map t —» Ei (t,x) is not continuous in the sense of Hausdorff’s distance. 


3. Main Results 

In this section we describe main results of the paper that concern faithful representations of Hamiltoni¬ 
ans satisfying the existence and uniqueness conditions. We start with proving that representations are not 
determined uniquely. In addition to this, they can be totally irregular. 

We consider the Hamiltonian H: RxR —» R given by the formula H(x,p)\p\. We notice that the triple 
([ - 1> l],/,0 is a representation of this Hamiltonian if functions /,/: Rx [—1,1] —» R satisfy the following 
conditions: 

(3.1) |/(x,a)|^l,/(x,l) = l,/(x,-l) = -l and l(x,a) > 0, /(x, 1) = Z(x,-1) = 0. 

Let h(-) and k(-) be arbitrary functions on R with values in [0, oo). Then 

(3.2) fh(x,a) := a(l+\a\h(x))/(l + h(xj), lk(x,a) := (1 - \a\)k{x), xgR, ag [-1,1] 

satisfy conditions (3.1). Therefore, every triple ([-1,1 ],//,,4), where //,,/a are given by (3.2), is a represen¬ 
tation of the Hamiltonian H(x,p) = \p\. There exist also representations with nonmeasurable (with respect 
to the state variable) functions //,/a, for instance if h(-) and k(-) are not measurable. However, our results 
show that from the set of representations one can always choose a faithful representation. 

3.1. Representation ( A , f,l ) with noncompact set A . This subsection is devoted to the new represen¬ 
tation theorem for convex Hamiltonians, with noncompact control sets. 

Theorem 3.1 (Representation). We suppose that H satisfies (H1)-(H3) and (HLC). Then there exists 
f : [0, T] xR” x A —> R" and l: [0,T] x R” x A —> R, measurable in t for all ( x,a ) G R" x A and continuous 
in {x,a) for all t G [0, T], with the control set A := R" +1 , such that for every t G [0, T], x,p G R" 

H(t,x,p)= sup {( p,f(t,x,a))-l(t,x,a )} 

aeR " +1 
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and f(t,x,A ) = dom//*(f,x, •)■ Moreover l(t,x,a ) ^ -\H(t,x,0)\ for all t e [0,T], x e R", a e R n+i . 
Furthermore, for all R>0, t € [0, T] \ Mr, x e Br, a,b e f ?" +1 

f \f(t,x,a)-f(t,y,b)\ f 10 (n+ l)[k R (t)\x-y\ + w R (t,\x-y\) + \a-b\] 

1 \l(t, x,a) - l(t,y,b) | SC 10 (h + l)[£s(f)|x-;y| + w r(L |x-y|) + \a — b\]. 

Next, if (H4) is verified, then for any t e [0, T ], x e R”, a € R ' ,+1 
(3.3) |/(U,fl)Kc(0d+W). 

Furthermore, if FI is continuous, so are f,l. 


The proof of Theorem 3.1 is contained in Section 5. On the basis of the following example we show a 
simplified version of construction of faithful representation from the above theorem. 

Example 3.2. Let H and L be as in Example 2.13. We know that H satisfies assumptions (H1)-(H4) and 
(HLC). We notice that the set K := epiL(0, •) is nonempty, closed and convex, and K + (0, \x\) = epi Lix, •). 
Let Pr : R 2 —> K be a projection of the space R 2 to the set K. Obviously, this function fulfills the Lipschitz 
continuity. We define functions /, l : R x R 2 —> R by the formulas: 

f(x,a)'.-n\oP K (a), l(x,a) := 7t2° Pk(ci) + \x\, V(i,a)eMxR 2 , 

where zri( 3^1 , 3 ^ 2 ) = }’] and 7r2(yi,y2) = yi for every yi,y 2 e R- We show that the triple (R 2 ,/,/) is a represen¬ 
tation of the Hamiltonian H. Let e(x,a) := ( f(x,a),l(x,a )) for every x e R, a e M 2 . Then 

e(x, a) = (7Ti o P K ( a ), n\ o P K (a)) + (0, |x|) = P K (a) + (0, \x\) 

for every x e R, a e R 2 . Therefore, e(x,R 2 ) = P/f(R 2 ) + (0,|x|) = K + (0, |x|). Thus, e(x,R 2 ) = epiL(x,-) = 
Er(x). It means that the Hamiltonian H and the triple (R 2 ,/,/) satisfy assumptions of Proposition 5.7, so 
the triple (R 2 ,/,/) has to be a representation of the Hamiltonian H. 

3.2. Necessary condition of existence of representation ( A,f,l ) with compact set A. We start this 
subsection introducing the condition for an upper bound of the Lagrangian on the effective domain. 

There exists A : [0, T] x R" —> R measurable in t for all x e R" and continuous in x for 
all te [0,r] such that L(t,x,v ) ^T(f,x) for every t e [0,T], xeR”, v e domL(f,x, •), 

L,L furthermore for any R > 0 there exists wr(-, •) - modulus and Mr - null set such that 

\A(t,x) - A(t,y)\ < WR(t, |x-y|) for every t e [0,T] \Mr and x,y &Br. 

Theorem 3.3. Let A be a nonempty compact set. We suppose that f : [0, T\ x M" x A —> M" and l: [0, T] x 
M"xA —> R are t—measurable for all (x,a) € R"xM m and (x,a)—continuous for all t € [0,r], Further on, we 
assume that for every R> 0 there exists the modulus w/?(-, •) and a null set Mr such that \l(t,x,a) — l(t,y,a)\ ^ 
WR(t,\x — y\)for every t e [0, T ] \Mr, x e Br, a e A. If the Hamiltonian H is given by the formula (1.4), then 
the Lagrangian L given by (1.5) satisfies the condition (BLC) with the same modulus wr(-,-). Moreover, if 
f,l are continuous, then A is also continuous. 

The proof of Theorem 3.3 is contained in Section 4. It follows from this Theorem that the condition 
(BLC) is necessary condition for existence of a continuous and /-measurable faithful representation (A,/,/) 
with the compact control set A. We explain the above theorem on the basis of the following example. 


Example 3.4. We define the Hamiltonian H : [0, T] x R x R —> R by the formula: 


H(t,x,p ) := 


|x| max{ \p\ -1 lnf|, 0} if te(0,T], 
0 if f = 0 . 


This Hamiltonian is continuous and satisfies assumptions (H1)-(H4) and (HLC). From Theorem 3.1 there 
exists a continuous faithful representation (A,/, l) of this Hamiltonian with the control set A := R 2 . 
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The LagrangianL : [0,T] xRxR —* RU{+oo) given by (1.5) has the form 

{ +oo if v 4 [-|x|,|x|], t G (0,7’], 

I Inf I |v| if v€[-\x\,\x\],t€(0,T], 

0 if v = 0, t = 0, 

+oo if v # 0, t = 0. 

Obviously, dom L(t,x,-) — [-|x|,|x|] for ( t,x ) e (0,r] xR. and dom L(t,x,-) = 0 for t = 0, x e R. The func¬ 
tion t — > L(f, 1,1) = | In r| on (0,T] cannot be upper bounded by a continuous function T(-, •) on [0,T] X R. 
Therefore, by Theorem 3.3 we have that for this Hamiltonian there does not exist a continuous faithful 
representation (A,/,/), with the compact control set A. We notice that the function v —» L(t,x,v) is upper 
bounded by the function A(t,x) = k(t)\x\ on the set domL(f,x, •) for every (t, x) e [0J]xR, where k(t) := |lnf| 
for 1 e (0, T] and kit) := 0 for 1 - 0. Therefore, L satisfies the condition (BLC). By Theorem 3.6 there exists 
a f-measurable faithful representation (A,/,/) of this Hamiltonian with the compact control set A. More¬ 
over, a set-valued map t —> dom L(t,x,-) is not continuous in the Hausdorff’s sense for all x / 0. Thus, the 
set-valued map t —> Ei (t,x) is also discontinuous in the Hausdorff’s sense for all x 4 0. 

Remark 3.5. By Theorem 3.3 we have for Hamiltonians from Examples 2.13, 2.14, 2.15 that there exist 
neither continuous nor f-measurable faithful representations (A,/, l) with the compact control set A, because 
functions v —> L(t,x,v ) of these examples are not upper bounded on the effective domain. Obviously, by 
Theorem 3.1 there exist continuous faithful representations (A,/,/) of these Hamiltonians with the noncom¬ 
pact control set A. 

3.3. Sufficient condition of existence of representation ( A,f,l ) with compact set A. This subsection 
is devoted to the new representation theorem of convex Hamiltonians, with the compact control sets. 

Theorem 3.6 (Representation). We suppose that H satisfies (H1)-(H4) and (HLC). Let L be given by 
(1.5) and satisfy (BLC). Then there exist f : [0, T] x R” x A —> R" and l: [0, T] x R” x A —> R, measurable 
in t for all ( x,a ) e R" x A and continuous in (x,a)for all t e [0, T ], with the control set A := B c R" +1 , such 
that for every t e [0, T], x,p e R" 

H(t,x\p) = sup {( p , f(t,x,a))- l(t,x , a)} 

a€B 

and f(t,x,A) — domL(f,x,-)- Moreover, we have: 

(Al) For any R> 0 and for all t e [0, T] \ A/r, x,y&Bn, a,b&B 

( \f(t,x,a)-f(t,y,a)\ < 10(n+ l)[k R (t)\x-y\ + w R (t,\x-y\) + \M(t,x)-M(t,y)\] 

\ \f(t,x,a) - f(t,x,b)\ ^ 10(« + \)M(t,x)\a-b\, 

where M(t,x) := \Mt,x)\ + |//(f,x,0)| + c(f)(l + |x|) + 1. 

(A2) \f(t,x,a)\ Sj c(/)(l + |x|) for all t e [0,T], x e R", ae B. 

(A3) Forany R>0 andforall t €[0 ,T]\A[r, x,yeBR, a.beB 

( | l(t,x,a) - l(t,y,a)\ ^ 10(n + l)[£ff(f)|x-y| + wr( 1, \x-y\) + \M(t,x ) - M(t,y)\] 

\l(t,x,a) — l(t,x,b)\^. 10(n+ \)M{t,x)\a-b\, 

(A4) Furthermore, if FI, /!(•,•), c(-) are continuous, so are f,l. 

The proof of Theorem 3.6 is contained in Section 5. Now we point out the differences between our 
construction of faithful representation and the ones contained in [12, 21], In order to do this, we consider 
two following examples. 

Example 3.7. Let the Hamiltonian H be as in Example 2.11. We know that this Hamiltonian satisfies 
assumptions (H1)-(H4) and (HLC). Our construction of representation ( A,f,l ) of this Hamiltonian leads 
to the set A = [-1,1] x [-1,1] and functions: 

f(x,a\,a 2 ) = ai|x|, l(x,a\,a 2 ) = |ai| + |a 2 l(l _ Mil), 
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that satisfy the Lipschitz continuity. However, construction of representation (A,f,l) of this Hamiltonian 
that is contained in [12, 21] leads to the set A — [—1,1] and functions: 


f(x,a ) = a\x\, I(x,a ) = L(x,f(x,a )) = 


\a\ if x f 0 
0 if x = 0. 


We notice that the function / is discontinuous with respect to the variable x for all a e [-1,1] \ {0}. 

Example 3.8. Let the Hamiltonian H be as in Example 2.12. We know that this Hamiltonian satisfies 
assumptions (H1)-(H4) and (HLC). Our construction of representation (A,f,l) of this Hamiltonian leads 
to the set A = {(a i, 02 ) e R x R | a, + aj = 1) and functions: 

f(x,a\,ci 2 ) =a\, l(x,ai,ci 2 ) -02 + |x|, 

that satisfy the Lipschitz continuity. However, construction of representation ( A,f,l ) of this Hamiltonian 
that is contained in [ 12, 21] leads to the set A — [—1,1] and functions: 


f{x,a ) = a, l(x,a ) = L(x,f(x,a )) = -Vl - a 2 + \x\. 

We notice that the function l is continuous, but does not satisfy the Lipschitz continuity with respect to the 
variable a. Obviously, we have the equalities 


{p- f{x,a\,a 2 )-l{x,a\,a 2 )} = 


sup ip-ell — ci 2 — |x|] 


(ai,ci2 ): +tf]=l 


sup 

{a i,«2) : = I 

= sup < p-ci\ + Jl —a\ - |x| > = sup [p-f(x,a)-l(x,a)}. 

«!G[-1,1] l V J oel-1,1] 

3.4. Stability of representations. In this section we will see that the faithful representation obtained 
in the previous section is stable. 

Theorem 3.9. Let Hj,H : [0,7 ] xl"xl" —> R, i e N be continuous and satisfy (HI)—(H3), (HLC). We 
consider the representations (R” +l , /[,/,) and (R n+ \f,l) of Hj and H, respectively, defined as in the proof of 
Theorem 3.1. If Hi converge uniformly on compacts to H, then f converge to f and f converge to l uniformly 
on compacts in [0,T] xR"xR" +1 . Furthermore, ifHj,H,i € N satisfy (H4), then f,f,i e N satisfy (3.3). 

Theorem 3.10. Let Hi, H : [0, f]xR"x M” —> R, i e N satisfy (HI)—(H4), (HLC). We suppose that Li, L , 
i € N are given by (1.5) and satisfy (BLC). Let Hi, A/, Cj, i e N be continuous. We consider the representations 
( B,f,lj ) and (B,f,l ) of Hj and H, respectively, defined as in the proof of Theorem 3.6. If Hj, Aj, t'i converge 
uniformly on compacts to H,A,c, then f converge to f and U converge to l uniformly on compacts in 
[0, T] X R" X B. 

Theorem 3.11. Let Hj,H : [0,7] xR" xR" —> R, ieN satisfy (HI)—(H3), (HLC). We consider the repre¬ 
sentations (R n+ \fi,li) and ( W + \f,l) of Hj and H, respectively, defined as in the proof of Theorem 3.1. If 
Hj(t,-,-) converge uniformly on compacts to H(t,-,-) for all te [0, T], then f(t,-,-) converge to f(t,-,-) and 
Iff, ■, •) converge to l(t, ■, •) uniformly on compacts in R" X R' ,+1 for all t e [0, T], Furthermore, if Hj,H, i e N 
satisfy (H4), then f,f,i e N satisfy (3.3). 

Theorem 3.12. Let H t , H : [0, T] x R" x R" — > M, ieN satisfy (HI)—(H4), (HLC). We suppose that Li, L, 
i e N are given by (1.5) and satisfy (BLC). We consider the representations ( B,f,lj ) and (B,f,l) of Hi and 
H, respectively, defined as in the proof of Theorem 3.6. If Hft,-,-), Aft,-) converge uniformly on compacts 
to H(t, ■, ■), Aft, ■), and eft) —> c(t) for all t e [0, T], then fi(t, ■, •) converge to f(t, ■, •) and l ft, ■, •) converge to 
l(t, •, ■) uniformly on compacts in R" XB for all t 6 [0, T], 

The proofs of Theorems 3.9, 3.10, 3.11, 3.12 are contained in Section 6. 
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Theorem 3.13. Let Hj.H : [0,r] xR"xl" —> R, i e N be continuous and satisfy (HI)—(H3), (HLC). We 
consider the representations (M n+ \f,li) and (R” + ',/,/) of Hj and H, respectively, defined as in the proof of 
Theorem 3.1. If Hi and H satisfy the condition 


(3.4) 


sup 

(M\p)e [O.rjxfltfXR" 


\Hj(t,x,p)-H(t,x,p)\ 

1 + lpl 


-» 0, 

i —»oo 


VR> 0 , 


then f,f and lj,l satisfy the conditions 


sup \f(t,x,a)-f(t,x,a)\ --> 0, V R > 0, 

[0,rjxB/;xR" +1 ,_>0 ° 

sup \li(t,x,a)-l(t,x,a)\ --> 0, V R > 0. 

[0,rjxB/;xR" +1 !_> °° 


Furthermore, if Hj,H,i e N satisfy (H4), then f),f,i e N satisfy (3.3). 


Theorem 3.14. Let Hj,H : [0, T\ x R" x R" —> R, i e N satisfy (H1)-(H3), (HLC). We consider the repre¬ 
sentations (R n+ \fi,li) and (R n+ \f,l) of Hi and H, respectively, defined as in the proof of Theorem 3.1. IfHj 
and H satisfy the condition 


(3.5) 


sup 

(x,p)eB fi xM" 


| Hj(t,x,p)-H(t,x,p)\ 

1+Lpl 


-» 0, 

/—>oo 


Vfe [0,r], V/?>0, 


then f,f and satisfy the conditions 


sup \fi(t,x,a)-f(t,x,a)\ 

-» 0, 

Vfe[o,r], v/?>o, 

(x,a)eB R xR" +l 

i—> oo 


sup \lft,x,a) - l(t,x,a)\ 

-> 0, 

V t e [0, r], V R > 0. 

(A',a)eS e xI" +1 

i—>oo 



Furthermore, if Hj,H,i € N satisfy (H4), then f,f,i e N satisfy (3.3). 
The proofs of Theorems 3.13, 3.14 are also contained in Section 6. 


4. Proof of Theorem 3.3 

Before we prove Theorem 3.3 we state and prove three auxiliary lemmas. 

Lemma 4.1. We suppose that the set A is nonempty and compact. Let f : [0,T] xR" x A —> R" and 
l: [0,f]xR"xA->R be a—continuous functions for every t e [0, T], x e R". IfH : [0, T\ x R" x R" —> R is 
given by the formula 

H(t,x,p ) := sup {{p,f(t,x,a))-l(t,x,a)}, 

aeA 

then for all t e [0, T], x € R", a e A we have L(t,x,f(t,x,a )) ^ l(t,x,a), where L(t,x,-) := H*(t,x,-). 

Proof. We assume, by contradiction, that the assertion is false. Then there exist t e [0, T], x e R", a e A such 
that l(t,x,d ) < L(t,x,f{t,x,a)). Therefore ( f(t,x,a),l(t,x,d )) ^ epi L(t,x,-). The function p —> H(t,x,p) is 
finite and convex, so by [23, Thm. 11.1] the function v —» L(t,x,v) is proper, convex, lower semicontinuous 
and H(t,x,-) = L r (t,x, ■). Hence the set epi L(t,x, •) is nonempty, closed and convex. By Epigraph Separation 
Theorem, there exists /? € R" such that 

sup <(v,77),(p,-l)> < {(f(t,x,d),l(t,x,d)),(~p,-\)). 

(v,77)eepi L(t,x,-) 


(4.1) 
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If v e dom L(t,x, •), then (v,L(t,x,v)) e epi L(t,x, •)• Thus, by the inequality (4.1) and the equality H(t,x,-) = 
L*(t,x,-) we obtain 

H(t,x,p) = sup {(p,v)~ L(t,x,v)} - sup {(p,v)~ L(t,x,v)} 

velR” vedomL(/,.x;,-) 

= sup ((v, L(t,x, v)), (p, -1)) < sup <(v,77),(p,-l)> 

vedom L(t,x,-) (v,77)Gepi L(t,x,-) 

< ((f(t,x,d),l(t,x,d)),(p,- 1)) = (p,f(t,x,a)) -l(t,x,a) 

Sj H(t,xfp). 

Thus, we obtain a contradiction that ends the proof. □ 

Lemma 4.2. We assume that the set A is nonempty and compact. Let f : [0, T] x R" X A —> R" and l : 
[0, T] X R" x A —> M be an a—continuous function for every t e [0, T], x e R". We assume that the set 
f(t,x,A) is convex for every t e [0, T], x e R". If H : [0, T] x R" x R" —> R is given by the formula 

H(t,x,p) := sup {(p,f(t,x,a))-l(t,x,a)}, 

aeA 

then for all t e [0, T ], x € R" we have f(t,x,A) - dom L(t,x,-), where L(t,x,-)H*(t,x,-). 

Proof. We put t e [0, T] and x e R". The function p —> H(t,x,p) is finite and convex, so by [23, Thm. 
11.1], the function v —» L(t,x,v) is proper, convex and lower semicontinuous. By Lemma 4.1 we have the 
inequality L(t,x,f(t,x,a )) ^ l(t,x,a) for every aeA. Thus, by the property of the function v —» L(t,x,v ) we 
obtain f(t,x,A) c AomL(t,x, •)• Now we show that domL(f,x, •) c f(t,x,A). We suppose that this inclusion 
is false. Then there exist v e dom Lit.x, ■) and v 4- f(t,x,A). The set f(t,x,A) is nonempty, convex and 
compact, so by the Separation Theorem, there exist ~p e R" and numbers a,(3 e R such that 

(v,~p) ^ a < fl (f(t,x,a),~p), 'I aeA. 

We notice that by the above inequality we obtain the inequality 

(4.2) f-a Sj (f(t,x,a)-v,p), VaeA. 

We set f(t,x) := inf„ ey i l(t,x,a). Let h e N be large enough that the following inequality holds 

(4.3) L(t,x,v) —f(t,x) < n-(fi-a). 

Using assumptions, we get for q —n-p the existence of a^e A with 

H(t,x,q) = sup \{q,f(t,x,a))-I(t,x,a)} 

aeA 

(4.4) = ( q,f(t,x,aq))-l(t,x,aq ). 

Putting together the inequalities (4.3), (4.4) and (4.2), we obtain 

n-(J3 — a) > L(t,x,v)~f(t,x) 

= sup {(v,p)-H(t,x,p)}- f(t,x) 

peR" 

^ (v,q)-H(t,x,q)-f(t,x) 

= (v,q)-{q,f(t,x,a-q)) + l(t,x,af -£(t,x) 

> (v-f(t,x,aq),q) 

- < v-f(t,x,aq),-n-p) 

- n-(f(t,x,aq)-v,p) 

^ h-(p-a). 

Thus, we obtain a contradiction that ends the proof. □ 
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Lemma 4.3. We suppose that the set A is nonempty and compact. Let f : [0, T] x R" x A R" and l : 
[0,7’]xR"xA —> R be t—measurable functions for all ( x,a ) G R" xA and (x, a)—continuous for all t € [0,r]. 
IfH : [0, T] x R" X R" —> R is given by the formula 

H(t,x,p ) := sup {(p,f(t,x,a))-l(t,x,a)}, 

aeA 

then there exist a nonempty, compact set Ik and functions ff: [0, T] X R" X A —> R" and 1: [0, T] X R" X A —> R 
measurable in t for all (x, a) eR"xl and continuous in (x, si) for all t G [0, T ] such that for every t G [0, T], 
x G R”, p G R” we have 

(4.5) H(t,x,p ) = sup{(p,ff(f,x, a)) - l(/,x,a)}. 

aei 

Besides, for all t G [0, T], x G R" 

(4.6) ff(/,x,A) = conv/(/,x,A), l(f,x, A) = conv/(f,x,A), 

If for any R > 0 there exists modulus wr(-,-) and null set JVr such that \l(t,x,a ) - l(t,y,a)\ ^ WR(t, \x — y\) 
for all t G [0, T] \AIr, x g Br, aeA, then |l(f,x, a) - l(f,y, a)| SC WR(t,\x-y\) for every t e [0,r] \ Nr, x g Br, 
aG A and R > 0. 

Besides, if functions f,l are continuous, then functions £,TLare also continuous. 

Proof. We define a simplex in the space R' ,+1 by 

A := {(ai,...,a n+ i) G [0,1]” +1 | ai H- \-a, ,+i = 1). 

Obviously, the set A is compact. Moreover, we define the set A by A := A" +1 x A. We notice that A 
is a compact subset of the space R 2 " +2 . The functions ff, 1 are defined for every t e [0,T], x G R" and 
a= (fli,... ,a„+i,ai,.. .,a„+\) e A" +l x A = Aby formulas: 

n+ 1 n+ 1 

ff(f,x, a):= ^ ajf{t,x,ai ), l(f,x, a):= ^ ajl(t,x,ai ). 

i= 1 i= 1 

We notice that ff, 1 are f-measurable for all (x, a) G R" x A and (x, a)-continuous for all t e [0, T], Besides, 
if functions f,l are continuous, then functions ff, lare also continuous. 

Now we prove that the triple (A,ff, 1) satisfies the equality (4.5). To this purpose, we fix t G [0, T], x e R" 
and p G R". Let a:= (a,..., a, a i,. ..,a n + 1 ) G A. Then by the definition of the triple (A,ff, 1) we obtain 

ff(f,x, a) = f(t,x,a), l(f,x,a) = l(t,x,a). 

By the above equalities 

(p,f(t,x,a))-I(t,x,a) — (p,£(t,x, a)) - l(f,x,a) 

^ sup {(p,£(t,x, a)) - l(f,x,a)) 

a el 

for all a G A. Therefore we get the inequality 

(4.7) H(t,x,p ) < sup {(p,ff(f,x,a)> - l(f,x,a)}. 

aG A 

On the other hand, for every aG A 

n +1 

( p, ff(f,x, a)) - l(f,x, a) = ( r,[< p,f(t,x,a,)) — l(t,x,a,)\ 

i= 1 
«+l 

sC ^ a\H{t,x,p ) = H(t,x,p). 

i—1 

It means that the following inequality holds 

(4.8) sup{(p,ff(f,x,a)> - l(f,x,a)} ^ H(t,x,p). 

aEA 
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Combining the inequality (4.7) and (4.8) we obtain (4.5). 

The equality (4.6) follows easily from the definition of the triple (A,ff,l) and Caratheodory’s Theorem 
(see [23. Thm. 2.29]). 

Let | l(t,x,a) - l(t,y,a)\ ^ WR(t, \x - y|) for every t e [O.T] \ Mr, x e Br, a € A, R > 0. Then from the 
definition of 1 we have 

n +1 

|1(L x, a) - I{t,y, a)| < £ a t \l{t,x,a t ) - l{t,y,a t )\ 

i= 1 
n +1 

< OiW R (t, \x—y\) = w R (t,\x-y \) 
i= 1 

for all r e [0, T] \ A/fl, x e Br, ae A, R > 0. □ 

Proof of Theorem 3.3. By Lemma 4.3 there exist a nonempty, compact set A and functions ff, 1 measur¬ 
able in t for all (x, a) eff'xJi and continuous in (x,a) for all t e [0, T] such that the triple (A,ff, 1) is a 
representation of H and ff(f,x, A) = conv/(f,x,A) for every t 6 [O.T], x e R”. Therefore, by Lemma 4.2 we 
have for all t e [0, T], x e M" 

(4.9) ff(f,x,A) = domL(f,x, •)• 

Now, we prove that the condition (BLC) holds. Let A(t,x ) := sup a£jl l(f,x, a). Obviously, the function A 
is f-measurable for all x e R" and x-continuous for all t e [0, T], 

Set t e [0,T] and x e R". If v e domL(f,x, •) then by the equality (4.9), there exists ae A such that 
v = ff(f,x, a). Therefore by Lemma 4.1 

L(t,x,v ) = L(t,x,S(t,x, a)) ^ l(/,x,a) ^ A(t,x ). 

It means that L(t,x,v) eC A(t,x) for every t e [0,T], x e R", v e domL(f,x, •)• 

Let \l(t,x,a) - l(t,y,a)\ ^ w^(f,|x-y|) for all re [0,T] \A/r, xeBr, aeA,R> 0. Then by Lemma 4.3 we 
have |l(f,x, a) - l(r,y, a)| ^ wr(1, |x-y|) for every t e [0,T] \Nr, x e Br, ae A, R > 0. We set t e [0, T] \ATr, 
x e Br and R > 0. Let ae Abe such that A(t,x) = l(r,x,a). Then 

A(t,x)-A(t,y ) = l(f,x,a)-supl(f,y,a) 

^ l(r,x,a) - l(r,y,a) Sj w’R(t, |x-y[). 

In addition to this, t e [0, T] \ Nr, x e Br and R > 0 are arbitrary, so we have \A(t, x) - /l(f,y)| ^ wr(L |x -y|) 
for every t e [0, T] \ Nr, x e Br and R> 0. 

Besides, if functions f,l are continuous, then by Lemma 4.3, the functions f, 1 are also continuous. 
Therefore, the function A has to be continuous. □ 

5. Proofs of representation theorems 

First, we propose some auxiliary definitions and facts. By V/ c (W n ) we denote a family of all nonempty, 
closed and convex subsets of R'". Then, let Vi-AK") be a family of all nonempty, convex and compact 
subsets of R”'. 

Lemma 5.1 ([1, p. 369]). The set-valued map P : R'” x'P/^R”') —° Vi <c (S, m ) defined by 

P(y,K) := KnB(y,2d(y,K)) 

is Lipschitz with the Lipschitz constant 5, i.e. for all K,D e Vf c { R'”) and x,y e R m 

,N(P(x,K),P(y,D)) < 5(J4?(K,D) + \x-y\). 
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The support function cr(K, •): R m —> R of the set K G VkcQ& m ) is a convex function defined by 

<r(K,p) := max(p,x), Vpe R m . 

xeK 

Being Lipschitz, cr(K , •) is differentiable a.e. in R m . Let m(dcr(K,p )) be the element of dcr(K,p) with the 
minimal norm. It coincides with Wcr(K,p ) at every p 6 R m where tr(K, ■) is differentiable. 

Definition 5.2. For any K e Vk ;c (R m ), its Steiner point is defined by 

s m (K) := 1 f m(dcr(K,p))dp e K, 

vol (B) Jb 

where volfB) is the measure of the m-dimensional unit ball B c R"'. 

Lemma 5.3 ([1, p. 366]). The function s m (-) is Lipschitz in the Hausdorjf metric with the Lipschitz constant 
m on the set of all nonempty convex compact subsets of R"', i.e. 

\s m (K) - s m (D)\ < mJf(K.D), VK,D e V kc (R m ). 

Let a set-valued map E : [0, T] x R" —° R"' have nonempty, closed values. If a set-valued map t —> E(t,x ) 
is measurable for every x G R", then the single-valued map t —> d(y,E(t,x )) is measurable for every x G R", 
y G R m (see [23, Thm. 14.3]). If a set-valued map x —> E(t,x) is lower semicontinuous and has a closed 
graph for every t G [0, 71, then a single-valued map x —» d(y,E(t,x )) is continuous for every t G [0,71, y G R'" 
(see [23, Prop. 5.11]). Besides, the inequality \d(y,E(t,x)) - d(z,E(t,x))\ ^ |y-z| holds for every t e [0,r], 
x e M", y,z e R'". Thus, we obtain the following proposition: 

Proposition 5.4. We assume that a set-valued map E : [0, T] x I" —° R m has nonempty, closed values, 
E(-,x) is measurable for every x G M" and E(t, ■), has a closed graph and is lower semicontinuous for every 
t G [0,71. If a single-valued map M : [0, T] xR" —> R is t—measurable for each x G R" and x—continuous 
for every t G [0, T ], then a single-valued map defined by 

( t,x,a ) —> d(M(t,x)a,E(t,x)), V(t,x,a) G [0,71 xR"xR m 

is t—measurable for every (x,a) G R" xR" 1 and (x,a)—continuous for every t G [0,7’]. In addition to this, it 
is a (t,x,a)—continuous map, if M is continuous, E has a closed graph and is lower semicontinuous. 

Definition 5.5. Let dnlK.D) := sup-^Elz, D). We say a set-valued map F is upper (respectively, lower) 
semicontinuous in the sense of the Hausdorff’s distance , what we denote by use (Jlf- lsc), if for every 

point xo and arbitrary number s > 0, there exists a number c) > 0 such that for every x G B(xo,6) the condition 
dH(F(xo),F(x)) < s (resp. dH(F(x),F(xo)) < e) holds. 

Obviously, a set-valued map F is continuous in the sense of the Hausdorff’s distance (J^-continuous) if 
and only if it is J$?-usc and lsc. 

The Hausdorff’s distance between closed balls can be estimated in the following way: 

(5.1) J4?(B(x,r),B(y,s))^\x-y\ + \r-s\, Tx,y G R'\ Tr.s^O. 

Theorem 5.6. We suppose a set-valued map E : [0, T] x R" —° R'" has nonempty, closed and convex values, 
E(-,x ) is measurable for every x G R", E(t,-) has a closed graph and is lower semicontinuous for every 
t G [0, T], Let a single-valued map M : [0, T] X R" —> R+ be t—measurable for every x G R" and x—continuous 
for every t G [0, T], Then there exists a single-valued map e : [0,71 x R" x R"' —> R"' such that e(-,x,a) is 
measurable for every x G R", a G R"' and e(t,-,-) is continuous for every t G [0,7’]. Besides, for every 
t G [0,71, x,y G R", a,b G R m it satisfies the equality e(f,x,R m ) = E(t,x) and the inequality 

(5.2) \e(t,x,a) - e(t,y,b)\ ^ 5ni[Jf(E(t,x),E(t,y)) + \M(t,x)a - M(t,y)b\], 

Additionally, a single-valued map e is continuous, if M is continuous and E has a closed graph, and is 
lower semicontinuous. 

If a set-valued map Q : [0,7’] xR” —° R"' for every t G [0,7’], x G R" satisfies Q(t,x ) c E(t,x) and 
\\Q(t,x)\\ Sj M(t,x), then for every t G [0, T], x G R” we have Q(t,x ) c e(t,x,B) c E(t,x ). 



REPRESENTATION OF HAMILTONIAN 


19 


Theorem 5.6 is a version of Parametrization Theorems 9.7.1 and 9.7.2 from the monograph [1]. 

Proof of Theorem 5.6. Let ( t,x,a ) 6 [0, T] x R" x W n . We consider the closed ball G(t,x,a) c R"' of center 
M(t,x)a and radius 2 d(M(t,x)a,E(t,x)), i.e. 

G(t,x,a ) := B(M(t,x)a,2d(M(t,x)a, E(t,x))). 

By the inequality (5.1), Proposition 5.4 and [1, Cor. 8.2.13] a set-valued map G(-,x,a ) is measurable 
for every x e R", a e M m and a set-valued map G{t, •,•) is ^-continuous for every t e [0, T], Besides, 
||G(f,x,a)|| ^ < p(t,x,a ) for every t e [0, T], x e R", a e R m , where 

ip(t,x,a ) := M(t,x)\a\ +2d(M(t,x)a,E(t,x)). 

By Proposition 5.4 and the hypotheses, we obtain i p{-,x,a) is measurable for all x e M", a € R"' and 
is continuous for all t e [0, T], 

Let P be the map defined in Lemma 5.1. We set 

<!>(?, x,a) P(M(t,x)a,E(t,x)) — E(t,x) C\G(t,x,a). 

By Corollary 2.4 and hypotheses, the set <t>(t,x,a) is nonempty, compact and convex. The maps G(-,x,a ) 
and E(-,a ) are measurable and have closed values, so the map <!>(•, x, a) being their intersection is also 
measurable for all x e R", a e R m (see [1, Thm. 8.2.4]). Now we show that a map (D(f, •, •) is J^-continuous 
for all t e [0, T], Indeed, setting t e [0, T], the map €>(f, •, •) has a closed graph, because it is an intersection 
of maps G(f,-,-) and E(t,-) having closed graphs. Moreover, ||(D(f,x,a)|| ^ ip(t,x,a) for all x e R", a e R m . 
By continuity of we have 0(1, •,•) is locally bounded. It means that €>(?,-,•) is Jtf- use. Thus, 

we are to prove 0(f, •,•) is Jf?- lsc. To do this, it is suffices to show that it is lower semicontinuous in the 
Kuratowski’s sense, because it has compact values. We fix (x, a) € R" x R m and the open set O c R m such that 
<X>(f,v,a)nG#0. If intG(f,•,•) = 0, then G(t,x,a ) c O. We know a map G(f,•,■) has compact values and is 
^-continuous. Thus, we have G(t,x J ,a') c O for all (x',a') near (x,a). Therefore <\>(t,x',a') c G(t,x' , a') c 
O for all ( x' ,a ') near (x,a). Let z\ 6 <D((,r,a)nO and intGYt, •, •) / 0. Then by the definition of Git, •,•) there 
exists zi e E(t,x) n intG(f,x,a). Thus, the interval (zi,Z 2 ] c E(t,x) C\mtG(t,x,a). Consequently, we can 
find an element z € M m satisfying z e O n E(t,x) n mtG(t,x,a). Hence, for some s > 0 we have B(z,s ) c 
G(t,x,a) O. The set-valued map Git, •, ■) is a ball whose center and radius are continuous functions. 
Hence, for every ( x',a') sufficiently close to (x,a) we have B(z,s/2) c G(t,x',a'). On the other hand, E is 
lower semicontinuous, so B(z,s/2) n E(t,x') / 0 for all x' near x. Therefore for every ix’, a’) sufficiently 
close to ( x,a ) we have €>(f,x',a')nO^0. Thus, the map <J)(f,-,-) is lower semicontinuous. 

We define the single-valued map e from [0, T] x R" x R"' to R"' by 

e(t,x,a ) := s ; „(<X>(f,x,a)), 

where s m in the Steiner selection. Since (D is measurable with respect to t, using the equivalent of the 
definition of s m from [1, p. 365], we deduce that e is also measurable with respect to t. by Lemma 5.3 we 
have for all t, s e [0, T], x,y e R", a,be R m , 

(5.3) \e(t,x,a) - e(s,y,b)\ ^ mJf(fl>(f,r,a),fl>(ij,fc)). 

We have shown that <t>(f, •,•) is .TR’-coiitinuous for every t e [0,7’]. By the inequality (5.3) we have eit, •, •) 
is continuous for every t e [0, T], Additionally, if E has a closed graph and is lower semicontinuous, and M 
is continuous, then similarly to the above, one can prove that (D is ^-continuous. Then by the inequality 
(5.3) we have that a single-valued map e is continuous. 

We notice that by the inequality (5.3) and Lemma 5.1 for all t € [0,T], x,y e R", a,b e R m we obtain 

| e(t, x, a) - e(t,y, b)\ ^ 5 m[ Jt?(E(t, x), E(t,y )) + \M(t, x) a - M(t,y ) b\ ]. 

Now we show that e(t,x,W n ) — E(t,x). For this purpose, we fix t e [0,T], x e R" and z G E(t,x). Setting 

a := z/M(t,x ) 
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we derive 

uel”, M(t,x)a=z, <t>(t,x,a) = [z], 
the above and Definition 5.2 imply that 

e(t,x,a ) = s m ((t)(t,x,a )) = z. 

This means that E{t,x) c e(t,x,W“) for all t £ [0, T], x £ R". The opposite inclusion is the result of Defini¬ 
tion 5.2, i.e. e(t,x,a ) = s,„(<X>(f,x,a)) £ <i>(t,x,a ) c E(t,x ) for all t e [0, T], x e R", a £ R"'. 

Let the set-valued map Q : [0,T] x R" —° R m for every t e [0,T], x £ R" satisfies Q(t,x ) c E(t,x ) and 
||(2(f,x)|| ^ M(t,x). We prove that Q(t,x ) c e(t,x,B) c E(t,x) for every t £ [0,T], x £ R". For this purpose, 
we fix t e [0,r], x £ R" and z e Q(t,x). Using the hypotheses, we have z e E(t,x) and a := z/M(t,x ) e B. 
Therefore <t>(t,x,a) = {z}. By Definition 5.2 we get e(t,x,a ) = s„,(0(t,x,a)) = z. This means that Q(t,x) c 
e(t,x,B) for all t £ [0,T], x £ R". The second inclusion is the result of e(t,x,B) c e(t,x,R m ) = E(t,x). □ 

5.1. Proof of Theorem 3.1. This subsection is devoted to the proof of the new representation theorem 
for convex Hamiltonians, with noncompact control sets. 

Proposition 5.7. We suppose that a function p —> H(t,x,p) is proper, convex and lower semicontinuous. 
Let e(t,x,A ) = Ei(t,x) andL(t,x,-) = H*(t,x,-). Ife(t,x,a ) = ( f(t,x,a),l(t,x,a))for every a £ A, then 

(5.4) H(t,x,p ) = sup {(p,f(t,x,a))-l(t,x,a)}. 

a€A 

Besides, f(t,x,A) - domL(f,x, •) and l(t,x,a ) ^ — \H(t,x,0)\for every a£ A. 

Proof. We know that e(t,x,a ) £ Ei{t,x) for every a £ A, so ( f(t,x,a),l(t,x,a )) 6 Ei{t,x) for every a £ A. 
Therefore, by the definition of the set Eift,x ) we obtain L(t,x,f(t,x,a )) s) l(t,x,a) for every a £ A. Thus, 
f(t,x,a) £ dom L(t,x, •) for every a e A, because the function v —> L(t,x,v ) is proper (see [23, Thm. 11.1]). 
Therefore, for every a £A we have 

(p,f(t,x,a))-I(t,x,a) ^ ( p,f(t,x,a))-L(t,x,f(t,x,a )) 

< sup {(p,v) - L(t,x,v)} = H(t,x,p). 

vedom L(t,x,-) 


By the above argumentation f(t,x,A) c dom L(t,x,-) and 

(5.5) sup {(p,f(t,x,a))-I(t,x,a)} ^ H(t,x,p). 

aeA 

We fix v £ domL(f,x,-)- We know that ( v,L(t,x,v )) e Ei(t,x ) = e(t,x,A), so there exists a £ A such that 
(v,L(t,x, v)) = e(t,x,d ) = ( f(t,x,a),l(t,x,a )). Therefore, v = f{t,x,d ) and L(t,x,v) = l(t,x,d). Moreover, 


(p,v) - L(t,x,v) = 

< 


( p,f(t,x,a )) - l(t,x,a ) 
sup {( p, f(t , x, a) ) - l(t , x, a )}. 

aeA 


So domL(f,x,-) c f(t,x,A ) and 

sup {(p,v) - L(t,x,v)} < sup {{p,f(t,x,a))-l(t,x,a)}. 

vedom L(x,-) aeA 

By the last inequality and the equality H(t,x,-) = L*(t,x,-), that holds because of [23, Thm. 11.1], we obtain 

H(t,x,p ) = sup {(p,v)~ L(t,x,v)} 

vedom L(t,x,-) 

(5.6) ^ sup {(p,f(t,x,a)) — l(t,x,a)}. 

aeA 


Putting together inequalities (5.5), (5.6) we get the equality (5.4). Besides, f(t,x,A ) = dom L(t,x, ■). 
Finally, we notice that by the equality L(t,x,-) = H*(t,x,-) for all v £ R" we have L(t,x,v ) ^ -\H(t,x,0)\. 
Thus, l(t,x,a ) ^ L(t,x,f(t,x,a )) ^ -\H(t,x,0)\ for all a£A. □ 
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Theorem 5.8. We assume that H satisfies (HI)—(H3) and (HLC). Let L he given by (l .5). Then there exists 
a map e : [0, T] x R" x R" +1 —> R" +1 , measurable in t for all ( x,a ) € R" x R" +1 and continuous in (x,a) for 
all t e [0, T\ such that for every t e [0, T] and x e R" it satisfies 

(5.7) e(t,x,R n+l ) =E L (t,x). 

Moreover, for any R > 0 and for all t €[0 ,T]\JVr, x,yeBR, a,beR” +l 

(5.8) [ e(t,x,a) - e(t,y,b)\ ^ 10 (n + 1 )[k,R(t)\x—y\ + wr( 1, \x—y\) + \a — b\\. 

Furthermore, if FI is continuous, so is e. 

Proof. Let M(t,x ) = 1 and E(t,x ) := Eft,x) for every t e [0, T], xe R". Using hypotheses and Corollary 2.4 
we have the maps M and E satisfy assumptions of Theorem 5.6. Therefore, there exists a map e : [0, T] x 
R"xR" +1 —> R” +1 measurable in t for all (x,a) e R" xR" +1 and continuous in (x,a) for all t e [0,T] such 
that for every t e [0,T], x,y e R”, a,b e R" +1 it satisfies the equality (5.7) and the inequality (5.2). By the 
inequality (5.2) and Corollary 2.6 we have 

\e(t,x,a) -e(t,y,b)\ ^ 5{n+\)[J l if(Eft,x),Eft,y)) + \a-b\] 

^ 10(m + l)[^(0l't'-y| +WR{t,\x—y\)] + 5 (n + \)\a — b\, 

for all t e [0, T] \ATr, x,y e Br, a,be R" +1 and R > 0. It means that the inequality (5.8) holds. Additionally, 
if we assume that Hamiltonian H is continuous, then using hypotheses. Corollary 2.4 and Theorem 5.6 we 
obtain that the map e is continuous. □ 

Remark 5.9. Let e : [0, T] x R" x R" +1 —> R" +1 be a function from Theorem 5.8. We define two functions 
/ : [0, T] x R” x R' ,+1 —> R" and l: [0, T] x R" x R' ,+1 —> R by formulas: 

f(t,x,a):=7t v (e(t,x,a)) and l(t,x,a) := 7r^(e(t,x,a)), 

where n v {v,rj) = v and n n (v,rj) = // for every v e R" and tj e R. Then for every t € [0, T], x e R", a e R" +1 the 
following equality holds 

e(t,x,a) = ( f(t,x,a),l(t,x,a )). 

Thus, for every t e [0, T], x,y e R”, a, be R" +1 we obtain 

\f(t,x,a) — f(t,y,b)\ sj \e(t,x,a)-e(t,y,b)\, \l(t,x,a)-l(t,y,b)\ ^ \e(t,x,a) — e(t,y,b)\. 

It means, by Corollary 2.4, Proposition 5.7 and Theorem 5.8, that functions f,l satisfy every condition 
asserted in Theorem 3.1. 

5.2. Proof of Theorem 3.6. This subsection is devoted to the proof of the new representation theorem 
for convex Hamiltonians, with compact control sets. 

Proposition 5.10. We suppose that the function p —> H(t,x,p ) is proper, convex and lower semicontinuous. 
Let E^jJt,x) c e(t,x,B ) c Eft,x) and L(t,x,-) = H*(t,x,-). IfL(t,x,v ) Sj A{t,x) for all v e dom L(t,x,f and 
e(t,x,a ) = ( f(t,x,a),l(t,x,a )) for all aeB, then 

(5.9) H(t,x,p ) = sup {(p,f(t,x,a))-l(t,x,a)}. 

aeB 

Moreover, f(t,x,B) = domL(f,x, •)• 

Proof. Because e(t,x,a) e Eft,x) for every aeB, it follows that (f(t,x,a),l(t,x,a)) e Eft,x ) for every 
aeB. Therefore by the definition of the set Eft,x ), we obtain L(t,x,f(t,x,a)) f l(t,x,a) for every aeB. 
Hence f(t,x,a ) e dom L(t,x, •) for all aeB, because the function v—>L(t,x,v) is proper (see [23, Thm. 11.1]). 
Thus, for every aeB we have 

(p,f(t,x,a))-I(t,x,a) ^ ( p,f(t,x,a))-L(t,x,f(t,x,a)) 

< sup { (p,v) - Lit,x,v) ) = H(t,x,p). 

vedom L(t,x,-) 
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Thus f(t,x,B ) c dom L(t,x, •) and 

(5.10) sup {(p,f(t,x,a))-l(t,x,a)} fi,H(t,x,p ). 

a€B 

We set v e domL(f,x,-)- Using assumptions, L(t,x,v) ^ A(t,x). Therefore (v,L(t,x,v)) e Ej^(t,x) c 
e(t,x,B). So, there exists a e B such that ( v,L(t,x,v )) = e(t,x,d ) = ( f(t,x,d),l(t,x,d )). Hence v = f(t,x,a ) 
and L(t,x,v) = l(t,x,d). Besides, 

(p,v) - L(t,x,v) - (p,f(t,x,d))-l(t,x,a) 

< sup{(p,/(f,x,a))-/(f,x,a)}. 

a€B 

So dom/Tf, x, •) c f(t,x,B) and 

sup {(p,v)-L(f,x,v)} < sup{(p,/(f,x,a))-/(f,x,a)}. 

vedomL(.x;,-) 

By the last inequality and the equality H(t,x,-) = L*(t,x,-), that holds because of [23, Thm. 11.1], we obtain 

H(t,x,p ) = sup {(p,v) - L(t,x,v)} 

vedom L(t,x,-) 

(5.11) ^ sup {(p, ^(t, X, tt) ) /(?,X,ti)}. 

a€B 

Combining inequalities (5.10) and (5.11) we obtain the equality (5.9). Additionally, we have that 
f(t,x,B) = dom L(t,x, •). □ 

Theorem 5.11. We Assume that H satisfies (H1)-(H4) and (HLC). Let L be given by (1.5) and satisfy 
(BLC). Then there exists e : [0, T~\ x R" x B —> R" +1 , where B c R” +l , measurable in t for all (x, a) eR" xB 
and continuous in (x, a) for all t e [0, T] such that for every t e [0, T], x e K" 

(5.12) E^ L (t,x) c e(t,x,B) c El(i,x). 

Moreover, for any R > 0 and for all t € [0, T] \AFr, x,y € Br, a,b € B 

( \e(t,x,a)-e(t,y,b)\^ 10(n + l)[k R (t)\x-y\ + w R (t,\x-y\) + \M(t,x)a-M(t,y)b\], 

' ' \ where M(t,x) := \A{t,x)\ + \H(t,x,0)\ +c(f)(l + |x|) + 1. 

Furthermore, if H, /!(•,•), c(-) are continuous, so is e. 

Proof. Let M(t,x) \A(t,x)\ + \H(t,x,0)\ + c(f)(l + |xr|) + 1 and E(t,x ) := E^t, x) for every t e [0, T], x e 
R". Using hypotheses and Corollary 2.4 we have the maps M and E satisfy conditions of Theorem 5.6. 
Therefore, there exists a map e\ [0, T] x R" x B —> R" +1 , where B c R" +1 , measurable in t for all (x,a) e 
R" xB and continuous in ( x,a) for all t e [0, T] such that for every t e [0, T], x,y e R", a,b e B it satisfies the 
inequality (5.2). By the inequality (5.2) and Corollary 2.6 we have 

| e(t,x,a) - e(t,y,b)\ ^ 5(n + \)[Jif(E R (t, x), E R (t,yfi) + \M(t,x)a - M(t,y)b\ ] 

^ 10 (n + 1 )[k R {t)\x-y\ + w R (t, |x—y|)] +5(« + 1)| M(t,x)a - M(t,y)b\ 

for all t e [0, T ] \Jf R , x,y e B R , a,b eB and R > 0. It means that the inequality (5.13) is satisfied. Addition¬ 
ally, if we assume that H, A(-, •), c(-) are continuous, then the map M is also continuous. Using hypotheses. 
Corollary 2.4 and Theorem 5.6 we have the map e is continuous. 

Let Q(t,x ) := E \ j(t,x) for all 16 (0, T], xe R". We prove that Q satisfies the assumptions of Theorem 5.6. 
Obviously, E,\,L(t,x ) c E R (t,x) for every t e [0, T], xe R". Thus, it suffices to show that \\Exjft,x)\\ f M(t,x) 
for every t e [0, T], x e R". We fix t e [0, T], x e R" and (v,r/) e Exjft,x). Then by the definition of the 
set E,\x(t,x), we have that L{t,x,v) fi t] A(t,x ). Therefore, using assumptions and the equality L(t,x,-) - 
H*(t,x,-), we obtain 

v' e domL(f,x,-) and - \H(t,x,0)\ fi p < A(t,x). 
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By the point (M5) in Corollary 2.4 we have ||domL(f,x,-)ll Sj c(f)( 1 + |x|). So, |v| ^ c(f)(l + |x|) and \r/\ ^ 
|/l(f,x)[ + \H(t,x,0)\. Therefore, |(v, 77 )| ^ \A(t,x)\ + \H(t,x,0)\ + c(f)(l + |x|) < M(t,x). It means that a set¬ 
valued map Q satisfies the hypotheses of Theorem 5.6. By this Theorem, the condition (5.12) is satisfied. 

□ 

Remark 5.12. Let e : [0, f]xR"xB-» R" + ! be the function from Theorem 5.11. We define two functions 
/ : [0, f]xl"xB-> R” and l: [0, T] x R" x B —> R by formulas: 

f(t,x,a):-n v (e(t,x,a)) and l(t,x,a) := n n (e(t,x,a)), 

where n v (v,rf) = v and 7t n {v,rj) = 77 for every v e R” and /; € R. Then for every t e [0, T], x e R”, a € B the 
following equality holds 

e(t,x,a ) = ( f(t,x,a),l(t,x,a )). 

So, for every t € [0, T], x,y e R”, a,b e B we obtain 

\f(t,x,a) —f(t,y,b)\ ^ \e{t,x,a)-e{t,y,b)\, \l{t,x,a) - l(t,y,b)\ ^ \e(t,x,a) - e{t,y,b)\. 

By Corollary 2.4, Proposition 5.10 and Theorem 5.11, it means that functions f,l satisfy all conditions all 
the assertions of Theorem 3.6. 


6. Proofs of stability theorems 

We show here that the faithful representation obtained in this paper is stable. To do this, we need a few 
auxiliary definitions and facts. For a sequence {/C},' e ^ of subsets of R m , the upper limit is the set 

limsup/C :={xe R"' [ there exists Xj —> x such that Xj e K li for all large jeN), 

/—MX) 

while the lower limit is the set 


lint inf Kj := {x e R"' | there exists x ; - —> x such that x,- e Kj for all large / e N). 

/—MX 

The limit of a sequence exists if the upper and lower limit sets are equal: 

lim Kj := limsup Kj = lint inf Kj. 

i -> 00 /-> 00 

For nonempty, closed sets Kj and K, one has lim ,^00 Kj — K if and only if lim,-_>oo d(x, Kj) = d(x, K) for every 
x e R"' (see [23, Cor. 4.7]). Thus, using the inequality \d(x,K) - d(y,K)\ ^ |x-y|, that is satisfied for every 
x,y e R'” and every nonempty set K c R m , we obtain 


(6.1) limx, =x, lim Kj - K => lim d(xj,Kj) - d(x,K). 

/—400 /—»OO /—400 

If Kj and K are nonempty, closed subsets of a given compact set, then by [23, Chap. 4, Sec C.] 

(6.2) lim Kj = K <=> lim J^(Kj,K) = 0. 

/—400 /—400 

Theorem 6.1 ([23, Thm. 4.32]). Let Kj and Dj be convex sets in R m for all i 6 N. If convex sets K and D 
satisfy BfOintZ) / 0, then the following implication holds: 


lim Kj = K, lim Dj = D => lim (Kj n Dj) - K C D. 

i —400 /—400 /—400 
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6.1. Convergence of set-valued maps £/.,(■. ')• In this subsection we show that convergence of Hamil¬ 
tonians Hi implies convergence of set-valued maps E/f-, ■). 

Proposition 6.2. Let Hj, H : [0, T] x R" x R" —> R, i e N be continuous and satisfy (H3). We suppose that 
Li, L, i e N are given by (1.5). If Hi converge to H uniformly on compacts in [0, T] x R” x R", then 

(i) \\mmfLi(ti,Xi,Vi) ^ L(t,x,v) for every sequence {ti,xi, v,) —» (t,x, v), 

i —>oo 

(ii) V(f,x,v) e [0, T] xR"xR" V (?,-,x,) —> (t,x) 3 v ( -—> v : L,'(f;,x;,v;) —» L(t,x,v). 

Proposition 6.2 is a consequence of Wijsman’s Theorem [23, Thm. 11.34], 

Proposition 6.3. Let Hj,H : [0, T] x R" x R" —> R, i e N be continuous and satisfy (H3). We assume Lj, L, 
i € N are given by ( 1.5). If Hj converge to H uniformly on compacts in [0, f]xR”x R", then 

lim E[ Xti,Xi) = E[f t,x) for every sequence (ti,Xi) —> (t,x). 

i—> oo 

Proof. First, we prove that 

(6.3) lim sup £x ( (t,-, x ( ) c Eift, x), V (f,-,x/) —> (f,x). 

i—>oo 

We suppose that (f/,x,-) —» (t,x). Let (v,q) e limsup,^, Eift^x,). By the definition of upper limit sets, 
there exists the sequence {vj,qf) —> ( v,q ) such that ( Vj,r\j ) e ( 6 ;,,x (/ ) for all large j e N. Hence we have 
Lij (tij , Xij , v j) f ij j for all large j e N. By the point (i) of Proposition 6.2, 

L(t,x,v) s 2 liminfL,,(t/,,x;.,v/) < lim = ?/. 

j —»oo J J J /—»oo 

Therefore fv, 77 ) e Ejft,x), so the inclusion (6.3) is true. 

Thus, the equality of our Proposition is true if we prove that 

(6.4) Eift,x) c liminfExjfex,-), V (f/,x,-) —> (f,x). 

I —>00 

We assume (f,-,x,) —» (f,x). Let (v,?/) e Eift,x). Then L(t,x,v ) ^ 77 . Therefore the value L(t,x,v) is finite 
because the function v —» L(t,x,v ) is proper. By the point (ii) of Proposition 6.2, there exists a sequence 
Vi —> v ; such that L,(f/,x,-,v,) —» L(t,x,v). Therefore for large i e N, the values Li(ti,Xi,Vj ) have to be finite 
because the value L(t,x,v ) is finite. We notice that 

Li(ti,Xi,Vi ) < Li(tj,Xj,Vj ) + i)-L{t,x,v ) =: q 

Therefore (v,,r;,) —» (v% 77 ) and (v,-,^ ( ) e Eifti,Xi) for large i e N. It means that (v, 77 ) belongs to the set 
]iminf ( ^oo Ep(ti,xf), so the proof of inclusion (6.4) is over. □ 

Proposition 6.4. Let //,,// : [0,T] xR"xR" —> R, 7 e N foe continuous and satisfy (H3). We suppose that 
Li, L, i e N are given by (1.5). If Hi and H satisfy the condition (3.4), ffieu 

sup J^(ELft,x), Ejft, x)) -* 0, V/?>0. 

(M;)e[0,r]xfi fl 

Proposition 6.4 can be proven similarly like Propositions 2.9 and 2.10. 

6.2. Proofs of stability theorems. Let //,,// : [0,T] x R" x R" —> R, i e N be continuous and satisfy 
(H3). We assume Li, L , i e N are given by (1.5). We consider continuous single-valued maps Mj,M : 
[0, T] xR" —> R+, i e N. 

Let (t,x,a) e [0,T] xR"xR" +l and i e N. We consider the closed balls 

Gilt,x,a) := B(Mi(t,x)a,2d(Mi(t,x)a,EL l (t,x))), 

G(t,x,a ) : = B(Mlt,x)a,2dlM(t,x)a,Eilt,x))). 
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We notice that ||G,(f,x,a)|| ^ tpj(t,x,a ) and ||G(f,x,a)|| ^ ip(t,x,a ) for all t G [O.T], x G R", a G R" +l , i G N, 
where 

tfii(t,x,a ) := Mi(t,x)\a\ +2 d(Mj(t,x)a,Ei j (t,x)), 
ip(t,x,a)M(t,x)\a\ +2 d(M(t,x)a,Ee(t,x)). 

Let P be the map defined in Lemma 5.1. We define the following sets 

(t>i(t,x,a) := P(Mi(t,x)a,Ej jj (t,x)) = Ei ii (t,x)C\Gi{t,x,a), 

< l>(t,x,a ) := P(M(t,x)a,Ei(t,x )) = E[(t,x)C\G(t,x,a). 

By hypotheses and Corollary 2.4, we get that the sets <bj(t,x,a), <t>(t,x,a) are nonempty, compact, convex. 
We define the single-valued maps a,e from [0, T] xl"xl ” +1 to R " +1 by 

(6.5) ej(t,x,a ) := s n+ ] (<T>,(r, x,a)), e(t,x,a ) := s„+i(<I>(f,x,a)), 
where s n+ 1 in the Steiner selection. By Lemma 5.3 we have 

( 6 . 6 ) \ei(t,x,a) - e(s,y,b)\ ^ (n + 1 ).3f 1 (d>i(t,x,a),d>(s,y,b)) 

for all t,s € [0,T], x,y e R", a,b g R" +1 , i e N. 

We notice that by the inequality ( 6 . 6 ) and Lemma 5.1, we have 

(6.7) \ei(t,x,a) -e(t,x,a)\ ^ 5 (n + 1 )[,^f(Eeft,x), E(t,x)) + \Mj(t,x) - M(t,x)\ \a \]. 
for all t g [0,T], x e R", a e R" +1 , i g N. 

Theorem 6.5. Let Hi, H, Li, L, Mi, M, i e N be as above. If Hi converge to H and Mi converge to M 
uniformly on compacts, then 

ej(ti,Xi,aj) —» e(t,x,a ) for every sequence (L,x,-,a,') —* ( t,x,a ). 

Proof. We notice that if 

( 6 . 8 ) J^(®,'(f;,x,-,a,'),®(f,x,a)) —> 0, V (f/,x,-,a,) — *(t,x,a), 

then Theorem follows from the inequality (6.6). Let (f,,x,,a,) —> ( t,x,a ). Then, using hypotheses, we 
have Mj(ti,Xj) —» M(t,x). Therefore by Proposition 6.3 and the implication (6.1) we obtain a,j —> 

i p(t,x,a ). Therefore there exists a constant C > ip(t,x,a) such that ^,(L,x,-,a ( ) ^ C for every i G N. We 
have ||G(f,x,a)|| ^ tp(t,x,a) and ||G ! '(/,-,x,-,a ( )|| SC <pi(ti,Xi,aj ) for all i G N, so <f >(t,x,a) c G(t,x,a) c Be and 
(t>i(ti,Xj,ai) c Gj(tj,Xi,ai ) c Be for all i G N. It means that by (6.2), the condition ( 6 . 8 ) is equivalent to the 
condition 

(6.9) lim Oi(ti,Xi,ai) = 0(t,x,a), V (f;,x,-,a,) — *(t,x,a). 

i—>oo 

Thus, to prove the theorem it is enough to show the condition (6.9). Let ( tj,Xi,ai ) —»( t,x,a ). Then by 
Proposition 6.3, we obtain 

(6.10) lim E Lj (ti,Xi ) = E L (t,x). 

i — »co 

By the inequality (5.1) and adequate convergence, we have that 

Jf?(Gj(ti,Xi,ai), G(t, x,a)) ^ |i fj(tj, x t , af) - (pit,x, a)\ + 2 |Mffu xf)ai - M(t, x) a\ —* 0. 

Besides, we know that G(t,x,a) c Be and G,(L,x,,a<) c Be for all i G N and some constant C > 0. Then by 
( 6 . 2 ), we have the equality 

(6.11) lim Gi(ti,Xi,ai) = G(t,x,a). 

1-400 

If intG(t,x,a) / 0 then E[(t,x) n intG(f, x,a) / 0. Therefore by the equality (6.10), (6.11) and Theo¬ 
rem 6 . 1 , we have that lim^ooOifeX;,^) = 0 (r, jr, a). 

If intG(f,x,a) = 0 then G(t,x,a) and ( l>(t,x,a) are singletons that contain points M(t,x)a G Ei (t,x). Let 
}’,■ g <t>j(ti,Xj,ai). Then y, g G ; (f,,x/,a,). Therefore by definition of Gi(ti,Xi,ai) we have |y ( - - /W,(f,,x,)a,| ^ 
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2d(Mi(ti,Xi)ai,E (f, X;)). Obviously, Mj(ti,Xj)cij —> M(t,x)a. Therefore by the equality (6.10) and the 
implication (6.1) we obtain 2<i( /W,- (f, x,-) a ,■, £ /^ (fo, x,-)) —» 2 d{M(t,x)a,Eift,x)) = 0. Thereforey, —> M(t,x)a. 
It means M(t,x)a e liminf^oo ( b,(f,-,x,-.a,). So by the equality (6.11) 

{M(f,x)a} c lirninf <I>,(f,,x,,< 2 ,) c limsup0,-(f/,x/,a,-) c G(t,x,a ) = {M(f,x)a). 

'-* 00 /—>oo 

Therefore lim,_>oo <!>,■(/,■,x,-,a ( -) = { M(t,x)a ) = 0(f,x,a) that ends the proof. □ 

Theorem 6.6. Let //„ //, L„ L, i g N foe as above. If Hj and H satisfy the condition (3.4) then 

sup \eft,x,a)-e(t,x,a)\ -—» 0, V£>0. 

(;,A,a)e[0,rjxBRXR' i+1 ,_>00 

Proof. Let Mft,x) = M(t,x ) = 1. B the inequality (6.7) and Proposition 6.4, we obtain 

sup \ei(t,x,a)-e(t,x,a)\ < 5(« + l) sup J4?(EL i (t,x),E(t,x)) 

(t.x,a)€ [0,rjxB R xR" +1 (t,x)e [0,T]xB R 

-> 0 

i —»oo 

for every R> 0, that ends the proof. □ 

Remark 6.7. Let e,.e : [0,T] xl"xR" +1 —> K' ,+1 be functions given by formulas (6.5). For all i e N we 
define the functions f,f : [0, T] x R" x R” +1 —> R" and l: [0, T] x R" x R” +1 —> R by formulas: 

f(t,x,a)n v (e(t,x,a )) and lft,x,a) := n n (e(t,x,a)), 
f(t,x,a):=n v (e(t,x,a)) and l(t,x,a) := ^(e(f,x,a)), 

where n v (v,rj) = v and = r/ for every v e R" and /; € R. Then for every t e [0,T], x G R”, a G R” +1 , 

i g N the following equalities hold: 

(6.12) eft,x,a) — (fit,x,a),li(t,x,a)), e(t,x,a) - ( f(t,x,a),I(t,x,a )). 

The equality (6.12) and Theorem 6.5 imply Theorems 3.9 and 3.10 if instead of Mft.x), M(t,x ) we take 
Mj(t,x) = M(t,x) = 1 and 

Mj(t,x ) := \Aj(t,x)\ + \Hj(t,x,0)\ + c,(f)(l +|x|) + 1 
M(t,x) := |T(f,x)| + |//(f,x,0)| + c(f)(l + |x|) + 1, 

respectively. By the equality (6.12) and Theorem 6.6, we get Theorem 3.13 if instead of Mft,x), M(t,x ) we 
take Mj(t,x) = M(t,x ) = 1. 

Theorems 3.11, 3.12, 3.14 can be proven similarly as above, indeed, it is enough to fix t G [0, T], 
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